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(54) Translating apparatus and translating method 

(57) A translating apparatus and a translating 
method wherein a first language sentence is divided (4) 
into syntax units consisting of predetermined units of 
sentence structure such as clauses and phrases in 
stages from large syntax units into small syntax units 
and at each stage stored (3,5) examples most similar to 
these syntax units are detected (6) using probability 
(11) models taking into account grammatical attributes 
of the syntax units and of the examples and using gen- 
eralized linguistic knowledge and with reference to a 
thesaurus (1 2) and the syntax units are translated (7) on 
the basis of these detected examples and the results of 
translation of the syntax units are compounded to gen- 
erate a second language sentence. The invention 
makes it possible to carry out high-quality translating 
efficiently and therefore at a high processing speed 
while eliminating the need for many superficially differ- 
ent examples having the same meaning content to be 
prepared and the need for the thesaurus (12) to be reg- 
ularly structured or have uniform distances between 
concepts. 
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Description 

Background of the Invention 
1 . Field of the Invention 



This invention relates to a translating apparatus and a translating method, and particularly to a translating appara- 
tus and a translating method for translating a first language sentence expressed in a first language into a second lan- 
guage sentence expressed in a second language using examples. 



2. Description of the Related Art 



Translating apparatuses for translating a first language sentence expressed in a first language .nto a second lan- 
guage sentence expressed in a second language can be generally divided into the three classes: rule-driven translation 
apparatuses, example-using translation apparatuses, and example-driven translation apparatuses. 

Fig 1 shows the construction of an example of a rule-driven translation apparatus. In Fig. 1 . an inputting part 1 con- 
sists of for example a keyboaid or a voice recognition device or a character recognition dev.ce; a fart language sen- 
tence is inputted into it and is converted into a form such as text data and outputted. That is. when the inputting part 1 
consists of a keyboard, a first language Sentence is inputted by the keyboard being operated and test data correspond- 
ing to that operation is outputted. When the inputting part 1 is a voice recognition device, a first language sentence is 
inputted as voice and voice-recognized. Text data corresponding to the results of the voice recognition is then outputted. 
When the inputting part 1 is a character recognition device, a first language sentence written for example on paper . s 
inputted (read) and this first language sentence is character-recognized. Text data corresponding to the results of this 
character recognition is then outputted. 

The text data corresponding to the first language sentence outputted from the inputting part 1 is supplied to an ana- 
lyzing part 31 . In the analyzing part 31 . the f irst language sentence from the inputting part 1 is language-processed 
(analyzed) on the basis of knowledge and rules relating to the first language, and the results of this analysis are sup- 
plied to a converting part 32. The converting part 32 converts the analysis results from the analyzing part 31 into an 
intermediate language sentence of a prescribed intermediate language on the basis of knowledge and rules retabng to 
the first language and a second language, and outputs this to a generating part 33. The generating part 33 generates 
from the intermediate language sentence supplied from the converting part 32 a corresponding second language sen- 
tence, that is. a translation (second language sentence) consisting of the first language sentence translated into the 
second language, on the basis of knowledge and rules relating to the second language. 

An outputting part 16 is made up of for example a display or a voice synthesizing device and a speaker or the like, 
and displays or outputs in a synthesized voice the second language sentence supplied from the generating part 33. 

Fig 2 shows the construction of an example of an example-using translating apparatus. Parts '"the figure corre- 
sponding to parts in Fig. 1 have been given the same reference numerals and will not be described m the following. 
Apart from being provided with a collating part 41 and a replacing part 42. this example-using translating apparatus is 
of the same construction as the rule-driven translation apparatus of Fig. 1. 

In this example-using translating apparatus, examples in sentence units expressed in a first language and corre- 
sponding translations consisting of the examples translated into a second language (hereinafter for convenience these 
examples and their corresponding translations will be called translation example data) are stored for example in the 
form of parameteis. and in the collating part 41 the first language sentence outputted by the inputting part 1 .s collated 
with the examples and any example matching the first language sentence is thereby detected. When there is an "am- 
ple which matches the first language sentence, the collating part 41 controls the replacing part 42 to replace the first 
language sentence with the translation corresponding to the example matching it Accordingly, in the replacing part 42. 
the f irst language sentence is replaced with the example matching it and supplied to the outputting part 16. 

When on the other hand there is no example which matches the first language sentence, the collating part 41 out- 
puts the first language sentence to the analyzing part 31 . Thereafter, in the analyzing part 31 . the converting part 32 
and the generating part 33. the same processing as in the case shown in Fig. 1 is carried out. and the second language 
sentence obtained as a result is supplied to the outputting part 16. . 

Details of this kind of example-using translating apparatus are disclosed for example in Japanese Unexammed Pat- 
ent Publication No. H.6-68134. 

Next Fig. 3 shows the construction of an example of an example-driven translating apparatus. Parte m Fig. 3 the 
same as parts in Fig. 1 have been given the same reference numerals and will not be described in the following. 

in this example-driven translating apparatus, a first language sentence outputted by the inputting part 1 is supplied 
to a Converting part 51 . and when the converting part 51 receives the first language sentence from the inputting part 1 

it controls a searching part 52 to search for the example most similar to that first language sentence. 

That is. translation example data is stored in sentence units in a translation example memory 53. and the searching 
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part 52 first refers to the translation example memory 53 and searches for an example which matches the first language 
sentence. When it finds an example which matches the first language sentence, the searching part 52 outputs this 
example and its corresponding translation to the converting part 51 . In this case, the converting part 51 supplies the 
translation from the searching part 52 unchanged to the outputting part 16 as a second language sentence 

5 When on the other hand it cannot find an example which matches the first language sentence, the searching part 

52 successively reads the examples stored in the translation example memory 53 and supplies them to a similarity 
degree calculating part 54. The searching part 52 makes the similarity degree calculating part 54 calculate a similarity 
degree expressing the conceptual similarity (the similarity in meaning) between each of the examples and the first lan- 
guage sentence using external knowledge such as for example a thesaurus. 

10 That is. a thesaurus wherein words are classified on the basis of their concepts in a tree structure is stored in a 
thesaurus memory part 55. In the thesaurus, nodes of the tree structure are equivalent to meaning concepts and so- 
called leaf parts are equivalent to words. Referring to this thesaurus, the similarity degree calculating part 54 calculates 
a degree of similarity between the first language sentence and the examples on the basis of the classes to which con- 
cepts common to words constituting the first language sentence and words constituting the examples belong. The 

15 searching part 52 then finds in the translation example memory 53 the example of which the similarity degree calcu- 
lated by the similarity degree calculating part 54 is the highest and supplies the translation corresponding to that exam- 
ple to the converting part 51. 

When the converting part 51 receives the translation from the searching part 52, it replaces those words of the 
translation which do not match (correspond with) words of the first language sentence with translations of those words 

20 and outputs this to the outputting part 16 as a second language sentence. 

Details of this kind of example-driven translating apparatus are disclosed for example in Japanese Unexamined 
Patent Publication No. H.3-276367. Also, details of methods of calculating the degree of similarity between a first lan- 
guage sentence and an example are also disclosed in for example Japanese Unexamined Patent Publication No. H.4- 
188276, Japanese Unexamined Patent Publication No. H.6-274546 and Japanese Unexamined Patent Publication No. 

25 H.6-274548 as well as the aforementioned Japanese Unexamined Patent Publication No. H.3-276367. 

However, in the kinds of translating apparatus described above, there have been the following problems. 
That is, in rule-driven translation apparatuses there has been the problem that information required for translation 
is sometimes lost in the process of analysis of the first language sentence, and consequently results of translation of 
greetings and other set phrases have become word-for-word in tone. Also, when the first language sentence includes 

30 for example proverbs or other idiomatic expressions (idioms), translating these correctly has been difficult. Also, build- 
ing and maintaining as a data base the knowledge and rules relating to the first language and the second language 
used in rule-driven translation apparatuses has not been easy. 

With example-using translating apparatuses, on the other hand, because the first language sentence is translated 
using a translation corresponding to an example matching it. if greetings and other set phrases and idioms and so on 

35 are stored as examples, it is possible to obtain a second language sentence which is a natural expression. However, in 
an example-using translating apparatus, when no example matching the first language sentence is stored, because 
processing similar to that of a rule-driven translation apparatus is carried out after all, the kinds of problem mentioned 
above arise, and furthermore storing examples completely matching the character strings of all first language sen- 
tences that might be inputted has been problematic. 

40 in an example-driven translating apparatus, because translation is carried out using examples whatever the nature 
of the first language sentence, the problems of the rule-driven translation apparatus do not arise, and also it is not nec- 
essary to store examples completely matching all possible first language sentences. 

However, in an example-driven translating apparatus, when there is no example matching the first language sen- 
tence, the example most similar to it is found and those of the words constituting the corresponding translation which 

45 do not match words constituting the first language sentence are simply replaced with translations of those words and 
this becomes the translation result, i.e. the second language sentence. Therefore, in an example-driven translating 
apparatus, linguistic knowledge and rules are not reflected in a generalized form and consequently the quality of the 
translation (the accuracy of the translation and the naturalness of the translation result) can only be increased by 
increasing the number of examples stored in the translation example memory 53 (whereas the quality of the translations 

so of a rule-driven translation apparatus can also be improved through the way in which knowledge and rules relating to 
the languages are described). Increasing the number of examples stored in the translation example memory 53 
increases the time required for the processing of searching for an example matching or similar to the first language sen- 
tence. 

The calculation of the similarity degree D (I.E) between a first language sentence I and an example phrase E in an 
55 example-driven translating apparatus, when the words constituting the first language sentence I are expressed i 1t ig. 
• • • , i t and the words constituting the example phrase E are expressed e 1 , e 2 , • • • , e t (where t represents the number 
of words constituting the first language sentence and the example respectively) has been carried out as shown in Exp. 
(1) by finding the distance in meaning (the conceptual distance) word-distancefo.ek) between each word i k constituting 
the first language sentence I and the corresponding word ej< in the example phrase E. assigning to it a weight corre- 
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sponding to the importance of the word and obtaining the sum total of these weighted distances. 

i 

D(l, E)= £ word-distance(i k ,e k )x weight k ( 1 ) 

.5 k = 1 

With this kind of similarity degree calculating method there have been the following kinds of problem. 
That is, for example when the meaning content of a certain example is spoken, although sometimes the example 
itself is spoken, in most cases a word such as the word constituting the subject in the example is omitted or extra words 

io are inserted. With the calculation method described above, because it is presupposed that the first language sentence 
and the example are made up of the same number of words, when the numbers of words in the two are different, it has 
been unclear whether or not it is possible to obtain a similarity degree correctly reflecting the similarity of the example 
to the first language sentence. 

Also, reversely, even if the first language sentence and the example are made up of the same number of words. 

75 when their word orders are different, again it has been unclear whether or not it is possible to obtain a similarity degree 
correctly reflecting the similarity of the example to the first language sentence. That is, if the first language is a language 
wherein words can be lined up in a relatively free order like for example Japanese, when for example 'RINGO O 
WATASHI WA TABETAI' ('an apple - I want to ear) is inputted as the first language sentence, even if for example 
•WATASHI WA MIKAN O TABETAI* ( I want to eat an orange") is stored as an example, because the 'RINGO' ('apple') 

20 and the WATASHI' (T) of the first language sentence respectively correspond to the 'WATASHI' (T) and the 'MIKAN' 
('orange') of the example, recognizing that the two sentences are similar has been problematic. 

Also, when for example the inputting part 1 consists of a voice recognition device, it sometimes happens that the 
speaker does not speak clearly and correct recognition is not achieved in the voice recognition device and text data 
wherein particles and the like are missing is outputted. That is. it sometimes happens for example that although the first 

25 language sentence intended by the speaker was 'WATASHI WA. ANATA NO MIKAN GA TABETAI' ('I want to eat your 
orange') the output of the inputting part 1 becomes 'WATASHI. ANATA. MIKAN. TABETAI' (1. you. orange, want to eat'). 
In this kind of case, when for example -WATASHI WA MIKAN O TABETAI' ( I want to eat an orange*) is stored as an 
example, the similarity degree should be calculated with the compound noun 'ANATA NO MIKAN* ('your orange'), con- 
sisting of the 'ANATA' and the 'MIKAN* in the output of the inputting part 1 joined together, being made to correspond 

30 with the MIKAN' ('orange') in the example, but with a method using Exp. (1) this has been difficult. 

To handle an input whose meaning content matches that of an example but which differs from the example as it 
were superficially, as described above, it is necessary to add examples corresponding to these superficial variations to 
the translation example memory 53, and as mentioned above this increases the time required for the searching proc- 
ess. 

35 Also, the distance word-distance(ik.©k) between the word i k and the word ej< has been determined on the basis of 
the class to which a concept common to the word i k and the word e k (the concept which belongs to the lowest class 
among the concepts including the word i k and the word e^ belongs in a thesaurus stored in the thesaurus memory part 
55. That is, the thesaurus is constructed by for example making the class to which the largest concepts belong the 0th 
class and then classifying smaller concepts into 1st through 3rd progressively lower classes and classifying words by 

40 assigning them to the concepts in the 3rd class to which they correspond, and with reference to this kind of thesaurus 
it is detected which of the 0th through 3rd classes the lowest concept common to the word i k and the word ^ belongs 
(hereinafter for convenience the C in Cth class will be referral to as the level). Then, according to whether that concept 
belongs to the 0th, the 1st, the 2nd or the 3rd class, the distance word^Jistancep^ek) is determined to be 0. 1/3, 2/3 or 
1 respectively. 

45 In this case, it is necessary that when the higher classes are seen from the words there are the same number of 
classes (in the case described above, the four classes of 0th through 3rd) above each word, and therefore the thesau- 
rus as a whole has had to have an as it were regular structure. 

Also, because the distance word-distancefo.e^ between two words is determined on the basis of the level of the 
class to which the common concept of the two words belongs (because it is determined on the basis of which of the 0th 

so through 3rd classes the class to which concept belongs is), the thesaurus must be so constructed that the distance 
between two words having a concept belonging to a certain class as their common concept and the distance between 
two words having a different concept belonging to the same class as their common concept is the same. 

Fig. 1 6 shows an example of a conventional thesaurus wherein concepts of words are classified into three classes. 
0th through 2nd. In the figure, the rectangles represent concepts and the circles represent words. 

55 In this kind of thesaurus, the concept C1 common to the words Wa and Wb is different from the concept C2 com- 
mon to the words Wc and Wd, but since the concepts C1 and C2 both belong to the 1 st class, according to the method 
of calculating the distance word-distanceO^) of the related art described above, the distance between the words Wa 
and Wb and the distance between the words Wc and Wd are the same. This means that the distance in meaning 
between concepts connected by lines is the same between any two concepts, and therefore it has been necessary for 
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the thesaurus to be so constructed that this is the case. 

However, constructing a thesaurus regularly and also so that the distance between concepts is the same, as 
described above, although it may be possible with a small-scale thesaurus, is very difficult in a thesaurus of any sub- 
stantial size. That is, if the thesaurus is constructed regularly it is difficult to make the distance between concepts fixed. 
s and if the thesaurus is constructed so that the distance between concepts is fixed it becomes difficult to maintain its reg- 
ularity. 

Therefore, a way of making possible high-quality translation using a non-regular thesaurus or a thesaurus wherein 
the distance between concepts is not fixed has been being sought. 

io Summary pf the Inveptipn 

It is therefore an object of the present invention to overcome the problems described above and provide a translat- 
ing apparatus and a translating method with which it is possible to carry out high-quality translation easily. 

To achieve the aforementioned object and other objects, the invention provides a translating apparatus for translat- 
es ing a first language sentence expressed in a first language into a second language sentence expressed in a second 
language comprising dividing means for dividing the first language sentence into syntax units consisting of predeter- 
mined units of sentence structure, detecting means for detecting examples similar to the syntax units of the first lan- 
guage sentence outputted from the dividing means, translating means for translating the first language sentence in 
syntax units on the basis of translations corresponding to the examples detected by the detecting means, and generat- 
20 ing means for generating a second language sentence by compounding the results of translation of the syntax units 
obtained by the translating means. 

The invention also provides a translating method comprising a step of dividing a first language sentence into syntax 
units consisting of predetermined units of sentence structure, a step of detecting examples similar to the syntax units 
of the first language sentence, a step of translating the first language sentence in syntax units on the basis of transla- 
25 tions corresponding to the detected examples, and a step of generating a second language sentence by compounding 
the results of translation of those syntax units. 

The invention also provides a translating method comprising a step of dividing a first language sentence into syntax 
units consisting of predetermined units of sentence structure in stages from large syntax units to small syntax units and 
collating the syntax units obtained at each stage and examples, a step of detecting examples corresponding to the syn- 
30 tax units on the basis of results of the collation, a step of translating the first language sentence in syntax units on the 
basis of translations corresponding to those detected examples, and a step of generating a second language sentence 
by compounding the results of translation of those syntax units. 

The invention also provides a translating apparatus comprising calculating means for calculating a word similarity 
degree expressing the similarity between a word constituting a first language sentence and a word constituting an 
35 example on the basis of the number of words included in a concept common to the word constituting the first language 
sentence and the word constituting the example in a thesaurus wherein words are classif ied in a tree structure on the 
basis of their concepts. 

The invention also provides a translating method comprising a step of calculating a word similarity degree express- 
ing the similarity between a word constituting a first language sentence and a word constituting an example on the basis 
40 of the number of words included in a concept common to the word constituting the f irst language sentence and the word 
constituting the example in a thesaurus wherein words are classified in a tree structure on the basis of their concepts. 

The invention also provides a translating apparatus comprising detecting means for detecting an example similar 
to a first language sentence on the basis of a priori probability of the example being used for translating the first lan- 
guage sentence and a transformation probability of the example being transformed into the first language sentence and 
45 used and translating means for translating the first language sentence on the basis of a translation corresponding to the 
example detected by the detecting means. 

The invention also provides a translating method comprising a step of detecting an example similar to a first lan- 
guage sentence on the basis of a priori probability of the example being used for translating the first language sentence 
and a transformation probability of the example being transformed into the first language sentence and used and a step 
so of translating the first language sentence on the basis of a translation corresponding to that detected example. 

The invention also provides a translating apparatus comprising extracting means for by performing syntax analysis 
on a first language sentence extracting grammatical attributes of the first language sentence and detecting means for 
detecting an example similar to the first language sentence taking into account grammatical attributes of the first lan- 
guage sentence and of the example and translating means for translating the first language sentence on the basis of a 
55 translation corresponding to the example detected by the detecting means. 

The invention also provides a translating method comprising a step of by performing syntax analysis of a first lan- 
guage sentence extracting grammatical attributes of the first language sentence and a step of detecting an example 
similar to the first language sentence taking into account grammatical attributes of the first language sentence and of 
the example and a step of translating the first language sentence on the basis of a translation corresponding to the 



5 



EXSDCOID: <EP____Q£05C03A2J_> 



EP 0 805 403 A2 



example detected by the detecting means. 
Brief Description of the Drawings 

* 5 Fig. 1 is a block diagram showing the construction of an example of a translating apparatus of the related art; 

Fig. 2 is a block diagram showing the construction of another example of a translating apparatus of the related art; 
Rg. 3 is a block diagram showing the construction of another example of a translating apparatus of the related art; 
Fig. 4 is a view showing a thesaurus used in a translating apparatus of the related art; 

Rg. 5 is a block diagram showing an example of the construction of a preferred embodiment of a translating appa- 
io ratus according to the invention; 

Rg. 6 is a view showing a thesaurus stored in a thesaurus memory 12 of Fig. 5; 

Rg. 7 is a flow chart illustrating the operation of the translating apparatus of Fig. 5; 

Figs. 8A and 8B are further views illustrating the operation of the translating apparatus of Rg. 5; 

Rgs. 9A through 9C are further views illustrating the operation of the translating apparatus of Fig. 5; 
15 Figs. 10A through 10C are further views illustrating the operation of the translating apparatus of Fig. 5; 

Rg. 1 1 is a flow chart illustrating a method for obtaining a priori probability P(Ej); 

Rg. 12 is a flow chart illustrating processing carried out by a converting part 7 shown in Fig. 5; 

Rg. 13 is a flow chart illustrating details of the processing of a step S32 in Fig. 12; 

Rg. 14 is another flow chart illustrating details of the processing of the step S32 in Fig. 12; 
20 Rg. 1 5 is a block diagram showing an example of the construction of another preferred embodiment of a translating 

apparatus according to the invention; and 

Rg. 16 is a flow chart illustrating processing carried out in the converting part 7 of Fig. 15. 
Detailed Description of the Preferred Embodiments 

25 

Rg. 5 shows the construction of a preferred embodiment of a translating apparatus according to the invention. 
Parts in Fig. 5 corresponding to parts shown in Fig. 1 have been given the same reference numerals and will not be 
described in the following. This translating apparatus, as will be further discussed later, divides a first language sen- 
tence into syntax units consisting of predetermined units of sentence structure, in stages, first into large syntax units 

30 and then into small syntax units, and translates the syntax units obtained at each stage using examples, and in this 
sense it can be called a multi-stage example-using translating apparatus. Here, as the first language sentence for 
example a Japanese sentence is inputted, and as a second language sentence constituting the result of translation of 
the first language sentence for example an English sentence is outputted. 

An inputting part 1 of this translating apparatus, like the inputting part mentioned above, consists of for example a 

35 keyboard or a voice recognition device or a character recognition device, and outputs in the form of text data or the like 
a first language sentence inputted into it. Here, the inputting part 1 detects the beginning and end of each word (or mor- 
pheme) constituting the first language sentence, and its part of speech, root and Chinese character reading and so on 
(hereinafter, this information obtained by morpheme analysis will for convenience be called morpheme information), 
and outputs these in the form of text data together with the first language sentence. 

40 The output of the inputting part 1 is supplied to a collating part 2. The collating part 2 collates examples stored in 
a set phrase translation example memory 3 with the first language sentence from the inputting part 1 and determines 
whether or not there is among the examples stored in the set phrase translation example memory 3 one which matches 
the first language sentence. When an example which matches the first language sentence from the inputting part 1 is 
stored in the set phrase translation example memory 3. the collating part 2 reads from the set phrase translation exarn- 

45 pie memory 3 a translation corresponding to this example and supplies it to an outputting part 16. Thus, in this case, 
processing is not carried out in subsequent stages of a clause dividing part 4 through to a clause compounding part 1 5. 
The translation from the collating part 2 is outputted by the outputting part 16 as the second language sentence. 

When no example matching the f irst language sentence from the inputting part 1 is stored in the set phrase trans- 
lation example memory 3. the collating part 2 outputs the first language sentence from the inputting part 1 and its mor- 

so pheme information to a clause dividing part 4. 

The set phrase translation example memory 3 stores translation example data made up of examples of for instance 
greetings and other so-called set phrases expressed in the first language (here, as mentioned above. Japanese) and 
corresponding translations consisting of these examples translated into the second language (here, as mentioned 
above, English). Therefore, when the first language sentence is a set phrase (a set phrase stored as an example in the 

55 set phrase translation example memory 3), the translation corresponding to the example matching that set phrase is 
supplied from the collating part 2 to the outputting part 16, and when the first language sentence is not a set phrase this 
first language sentence and its morpheme information is supplied from the collating part 2 to the clause dividing part 4. 

When it receives the first language sentence and the morpheme information from the collating part 2, the clause 
dividing part 4 determines whether or not there is in the first language sentence a clause matching any of the examples 
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stored in a clause division pattern translation example memory 5. and when there is such a clause in the first language 
sentence arts the first language sentence at this clause and thereby divides the first language sentence into clauses, 
or large syntax units. The clause dividing part 4 supplies parts of the result (clauses) of the division of the first language 
sentence other than the clause which matches one of the examples stored in the clause division pattern translation 

5 example memory 5 to a simple syntax analyzing processing part 6 together with the morpheme information. Also, the 
clause dividing part 4 reads from the clause division pattern translation example memory 5 the translation correspond- 
ing to the example matching the clause used to divide up the first language sentence and supplies this together with 
information relating to how the f irst language sentence was divided up (hereinafter referred to for convenience as clause 
division information) to the clause compounding part 15. 

w When on the other hand there is in the first language sentence no clause matching an example stored in the clause 
division pattern translation example memory 5. that is, when the first language sentence consists of a single clause, the 
clause dividing part 4 supplies the first language sentence unchanged to the simple syntax analyzing processing part 
6 together with its morpheme information. 

The clause division pattern translation example memory 5 stores translation example data made up of examples in 

75 clause units expressed in the first language and corresponding translations consisting of these examples translated into 
the second language. Here, examples of so-called patterned clauses such as for example 'DEKITARA* (If possible') are 
stored in the clause division pattern translation example memory 5. 

The simple syntax analyzing processing part 6, by carrying out so-called shallow syntax analysis on a clause con- 
stituting the first language sentence from the clause dividing part 4 on the basis of the morpheme information also from 

20 the clause dividing part 4, for example using language-governing rules (knowledge) described as regular grammar, 
divides the clause (when a plurality of clauses are supplied from the clause dividing part 4, each of the clauses) into 
phrase units. That is, here, the simple syntax analyzing processing part 6 divides up the first language sentence clause 
from the clause dividing part 4 into for example noun phrases, verb phrases and other phrases (for example adverb 
phrases and sentence modifiers and so on), and supplies these to a converting part 7. 

25 The simple syntax analyzing processing part 6, by carrying out syntax analysis, also carries out extraction of gram- 
matical attributes for each phrase, such as for example syntactic head (the main word of the phrase (for example the 
important part of a noun phrase (a modified word or the like) or when a noun phrase consists of a single noun, that 
noun) and modality (for example information relating to potential, conditional, desiderative and so on). Also, the simple 
syntax analyzing processing part 6 detects linkage relationships between phrases constituting the clause, and other 

30 syntax information (hereinafter called clause syntax information). The grammatical attributes and clause syntax infor- 
mation are supplied to the converting part 7 together with the phrases obtained as described above. 

The converting part 7 detects phrase unit examples most similar to the phrases of the first language sentence from 
the simple syntax analyzing processing part 6 from a noun phrase translation example memory 8, a verb phrase trans- 
lation example memory 9 and an other translation example memory 10, and carries out translation in phrase units on 

35 the basis of translations corresponding to these examples. 

That is, the converting part 7 controls a similarity degree calculating part 1 1 to calculate word similarity degrees 
expressing the similarity in meaning between the words in the examples stored in the noun phrase translation example 
memory 8, the verb phrase translation example memory 9 or the other translation example memory 10 and the words 
constituting the phrases from the simple syntax analyzing processing part 6, and on the basis of these word similarity 

40 degrees and other parameters (for example the grammatical attributes outputted by the simple syntax analyzing 
processing part 6) detects the examples most similar to the phrases from the simple syntax analyzing processing part 
6. In the converting part 7, when an example matching a phrase from the simple syntax analyzing processing part 6 is 
stored in the noun phrase translation example memory 8, the verb phrase translation example memory 9 or the other 
translation example memory 10, this example is detected as the example most similar to the phrase from the simple 

45 syntax analyzing processing part 6. 

Also, by referring to a translation dictionary 13, the converting part 7 replaces those of the words constituting the 
translation corresponding to the most similar example thus detected which do not correspond to words constituting the 
first language sentence with translations of those words, and outputs translations of phrases obtained in this way to a 
phrase compounding part 14 together with the clause syntax information from the simple syntax analyzing processing 

so part 6. 

The converting part 7 carries out the processing described above for each noun phrase, verb phrase and other 
phrase supplied from the simple syntax analyzing processing part 6. Detection of the phrase unit example most similar 
to a noun phrase, a verb phrase or an other phrase is carried out with reference respectively only to the noun phrase 
translation example memory 8, the verb phrase translation example memory 9 or the other translation example memory 

55 10. 

The noun phrase translation example memory 8, the verb phrase translation example memory 9 and the other 
translation example memory 10 respectively store examples in noun phrase units, verb phrase units and other phrase 
units. 

The similarity degree calculating part 11, under the control of the converting part 7, on the basis of a thesaurus 
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stored in a thesaurus memory 12, calculates degrees of similarity between the words constituting the examples stored 
in the noun phrase translation example memory 8. tire verb phrase translation example memory 9 or the other transla- 
tion example memory 10 and the words constituting the phrases outputted by the simple syntax analyzing processing 
part 6. The thesaurus memory 12 stores a thesaurus wherein words are classified in a tree structure on the basis of 

5 their concepts. The translation dictionary 1 3 stores words of the first language in association with corresponding words 
of the second language (words of the first language translated into the second language (translations)). 

The phrase compounding part 14, by compounding the translations of noun phrases, verb phrases and other 
phrases supplied from the converting part 7 on the basis of the clause syntax information also supplied from the con- 
verting part 7 and language-governing rules of the second language, produces clauses of the second language and 

10 supplies them to the clause compounding part 15. The clause compounding part 15 compounds the clauses and 
thereby produces a second language sentence constituting the result of translation of the first language sentence. 

That is, when the first language sentence is made up of a plurality of clauses, results of translation of a plurality of 
clauses are supplied to the clause compounding part 15 from the phrase compounding part 14. Also, a result of trans- 
lation of a clause may be supplied to the clause compounding part 15 not only from the phrase compounding part 14 

15 but also from the clause dividing part 4. By compounding (combining) the results of translation of a plurality of clauses 
supplied to it in this way the clause compounding part 15 produces a second language sentence. The second language 
sentence produced by the clause compounding part 15 is supplied to the outputting part 16 and outputted. 

From the clause dividing part 4, as mentioned above, besides a result of translation (a translation) of a clause, 
clause division information is also supplied to the clause compounding part 15. and the translations of clauses output- 

20 ted by the phrase compounding part 1 4 are compounded with the translation of the clause outputted by the clause divid- 
ing part 4 on the basis of this clause division information. 

Next, with reference to Fig. 6, the thesaurus stored in the thesaurus memory 12 will be described. In the thesaurus 
memory 1 2 is stored a thesaurus wherein words are classified in the same way as in for example the EDR (Japan Elec- 
tronic Dictionary Research Institute) concept dictionary, and Fig. 6 shows a part of this thesaurus (Source: 'Japan Elec- 
ts tronic Dictionary Research Institute. EDR Electronic Dictionary Product Edition (1.0th Edition), 1995'). That is, Fig. 6 
shows those words (enclosed by ellipses in the figure) in the thesaurus stored in the thesaurus memory 12 which can 
be expressed as 'go* (in the figure not the words themselves but rather their senses are shown), and their higher con- 
cepts (enclosed by rectangles in the figure). 

This thesaurus is not so constructed that when the classes above are seen from the words there are the same 

30 number of classes above each word. That is, when for example as in the case shown in Fig. 4 the class to which the 
highest concept belongs is made the Oth class and the classes below it are successively called the 1st class, the 2nd 
class, and so on. the word W1 having the meaning (sense) time passes' belongs to the 3rd-class concept of 'the pass- 
ing of time' and the word W2 having the meaning 'do gradually' belongs to the 7th-class concept of 'leave the place one 
has been until now'. Also, in this thesaurus, for example the word W3 having the meaning 'animal/person dies' and the 

35 word W4 having the meaning 'arrive at destination* are included in a plurality of concepts in the same class. That is. the 
word W3 is included in both of the 4th-class concepts of 'physiological phenomena of animals' and 'life going out', and 
the word W4 is included in both of the Tth-class concepts of 'subject moves to end point* and 'arrival'. 
Thus, this thesaurus is not constructed regularly. 

Also, this thesaurus is not so constructed that the distances between concepts joined by lines are the same. That 
40 is, for example the concept CI ('subject moves to end poinf) is connected to both the concepts C2 ('movement of sub- 
ject 1 ) and C3 ('arrival at end point'), but the distance between the concepts C1 and C2 cannot be said to be the same 
as the distance between the concepts C1 and C3. 

In the similarity degree calculating part 1 1 of Fig. 4, as will be further discussed later, word similarity degrees accu- 
rately reflecting similarities between words are calculated notwithstanding that the thesaurus is constructed in the way 
45 described above. 

Next, with reference to the flow chart of Fig. 7. the operation of the translating apparatus shown in Fig. 5 will be 
described. When a first language sentence is inputted into the inputting part 1 . in a step SO. the inputting part 1 converts 
this first language sentence into text data and generates morpheme information of the first language sentence and sup- 
plies these to the collating part 2. In a step S1 . the collating part 2 collates the examples stored in the set phrase trans- 
so lation example memory 3 with the first language sentence from the inputting part 1 and thereby determines whether or 
not there is an example stored in the set phrase translation example memory 3 which matches the first language sen- 
tence from the inputting part 1 . 

When in the step S1 it is determined that there is an example matching the first language sentence from the input- 
ting part 1 stored in the set phrase translation example memory 3. processing proceeds to a step S2 wherein the f irst 
55 language sentence is replaced with the translation corresponding to this matching example and then proceeds to a step 
S13. In the step S13. the translation obtained in the step Si is supplied from the collating part 2 to the outputting part 
16, which then outputs a second language sentence consisting of the first language sentence translated into the second 
language, and processing ends. 

When on the other hand it is determined in the step S1 that there is no example stored in the set phrase translation 
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example memory 3 which matches the first language sentence from the inputting part 1 , this first language sentence is 
supplied together with its morpheme information from the collating part 2 to the clause dividing part 4. Then, in the 
clause dividing part 4, in a step S3, it is determined whether or not there is among the clauses constituting the first lan- 
guage sentence a clause which matches one of the clause unit examples stored in the clause pattern translation exam- 
s pie memory 5. 

When in the step S3 it is determined that among the clauses constituting the first language sentence there is one 
which matches a clause unit example stored in the clause pattern translation example memory 5, processing proceeds 
to a step S4 and the clause dividing part 4 cuts the first language sentence at that clause, thereby dividing the first lan- 
guage sentence into clause units, and generates clause division information. The clause dividing part 4 then reads from 

w the clause pattern translation example memory 5 the translation of the clause among the clauses constituting the first 
language sentence which matches a clause unit example stored in the clause pattern translation example memory 5. 
and outputs this translation to the clause compounding part 15 together with the clause division information. Also, the 
clause dividing part 4 supplies the remaining clauses constituting the first language sentence to the simple syntax ana- 
lyzing part 6 together with the morpheme information, and processing then proceeds to a step S5. 

75 When on the other hand it is determined in the step S3 that there is among the clauses constituting the first lan- 
guage sentence no clause which matches a clause unit example stored in the clause pattern translation example mem- 
ory 5, that is, when for example the first language sentence is made up of a single clause, the clause dividing part 4 
outputs the first language sentence to the simple syntax analyzing part 6 together with the morpheme information and 
processing skips the step S4 and proceeds to the step S5. 

20 In the step S5. in the simple syntax analyzing part 6, syntax analysis is carried out on clauses constituting the first 
language sentence from the clause dividing part 4 on the basis of morpheme information also from the clause dividing 
part 4 and using language-governing rules (knowledge) of the first language, and as a result of this analysis the clauses 
of the first language sentence are divided into noun phrases, verb phrases and other phrases, and grammatical 
attributes of each phrase and clause syntax information such as linkage relationships between phrases constituting the 

25 clauses are generated. The phrases, the grammatical attributes and the clause syntax information are then supplied 
from the simple syntax analyzing part 6 to the converting part 7 and processing proceeds to a step SB. 

In the step S6. in the converting part 7. each of the phrases supplied from the simple syntax analyzing part 6 and 
the stored content of the noun phrase translation example memory 8. the verb phrase translation example memory 9 
or the other translation example memory 10 are collated and it is thereby determined whether or not a phrase unit 

30 example matching a phrase supplied from the simple syntax analyzing part 6 is stored in the noun phrase translation 
example memory 8, the verb phrase translation example memory 9 or the other translation example memory 10. When 
in the step S6 it is determined that an example matching a phrase supplied from the simple syntax analyzing part 6 is 
stored in the noun phrase translation example memory 8, the verb phrase translation example memory 9 or the other 
translation example memory 10, processing proceeds to a step S7 and the converting part 7 reads a translation corre- 

35 sponding to this matching example from the noun phrase translation example memory 8, the verb phrase translation 
example memory 9 or the other translation example memory 10 and outputs it to the phrase compounding part 14, and 
processing then proceeds to a step S10. 

Here, noun phrases, vert) phrases and other phrases for example obtained from the simple syntax analyzing part 
6 by sentence unit examples being inputted into the inputting part 1 are respectively stored in the noun phrase transla- 
te tion example memory 8. the verb phrase translation example memory 9 and the other translation example memory 10. 
Also, the noun phrases, verb phrases and other phrases obtained in this are stored in association with corresponding 
grammatical attributes. 

That is, phrase unit examples are stored in the noun phrase translation example memory 8, the verb phrase trans- 
lation example memory 9 and the other translation example memory 10 together with as it were abstract attributes 

45 thereof obtained as a result of syntax analysis, called grammatical attributes. Therefore, the converting part 7 can be 
given generalized linguistic knowledge and made to perform collation of phrases from the simple syntax analyzing part 
6 (hereinafter for convenience called input phrases) with the phrases stored in the noun phrase translation example 
memory 8, the verb phrase translation example memory 9 or the other translation example memory 10 (hereinafter for 
convenience called example phrases) taking into consideration grammatical attributes of the phrases (grammatical 

so attributes of the input phrases and of the example phrases), and efficient processing becomes possible as a result. 

Specifically, when for example the verb phrase YOYAKU O SHITE ITADAKITAI NO DESU GA' ('I'd like you to make 
a reservation*) has been inputted into the simple syntax analyzing part 6, as grammatical attributes (or 'slot-name val- 
ues') for example (gerund-suffix ITADAKU) (desiderative +) (extended-predicate +) (s-part GA) and (formal +) are 
obtained. Here, the most concise expression (as it were, the expression equivalent to a root) of the verb phrase 

55 YOYAKU O SHITE ITADAKITAI NO DESU GA' is 'YOYAKU O SURU' (to make a reservation'), and the slot-name value 
(gerund-suffix ITADAKU) means that 'ITADAKU' has been added like a suffix to this 'YOYAKU O SURU*. the slot-name 
value (desiderative +) means that an expression expressing desire (here, 'TAn has been added, the slot-name value 
(extended-predicate +) means that an expression for adding a predicate (here, *NO DESU') has been added, the slot- 
name value (s-part GA) means that an ending particle (here, *GA') has been added, and the slot-name value (formal +) 
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means that the sentence ending is polite (here, mat 'NO DESU' has been used as the sentence ending and not for 
example the less polite 'NO DA'). 

In this case, as generalized linguistic knowledge, for example the knowledge that the 'NO' of the expression corre- 
sponding to the slot-name value (extended -predicate +) sometimes becomes "N' is given to the simple syntax analyzing 
•5 part 6. and when for example YOYAKU O SHITE ITADAKITAI 'N DESU GA' (also meaning Td like you to make a reser- 
vation'), wherein the 'NO' in the verb phrase mentioned above has become "N\ is inputted as an input phrase, again the 
same slot-name values as in the case above of (gerund-suffix ITADAKU) (desiderative +) (extended-predicate +) (s-part 
GA) and (formal +) are outputted. 

Therefore, if the verb phrase YOYAKU O SHITE ITADAKITAI NO DESU GA' is stored together with its slot-name 
io values as an example phrase in the verb phrase translation example memory 9, in me converting part 7 the example 
phrase 'YOYAKU O SHITE ITADAKITAI NO DESU GA' is determined to match the input phrase YOYAKU O SHITE 
ITADAKITAI *N DESU GA'. 

Also, when YOYAKU O SHITE ITADAKITAI GA' (still meaning 'I'd like you to make a reservation*) consisting of the 
first-mentioned verb phrase YOYAKU O SHITE ITADAKITAI NO DESU GA' with the expressions corresponding to the 
is slot-name values (extended-predicate +) and (formal +) omitted is inputted as an input phrase, the slot-name values 
(gerund-suffix ITADAKU) (desiderative +) (s-part GA) are outputted by the simple syntax analyzing part 6. 

Now. let it be supposed that for example the knowledge that expressions corresponding to the slot-name values 
(extended-predicate +) and (formal +) can be ignored has been given to the converting part 7 as generalized linguistic 
knowledge. Then, assuming that the first-mentioned verb phrase YOYAKU O SHITE ITADAKITAI NO DESU GA' is 
20 stored together with its slot-name values as an example phrase in the verb phrase translation example memory 9, in 
the converting part 7 collation is carried out ignoring the (extended-predicate +) and (formal +) among the slot-name 
values of the example phrase YOYAKU O SHITE ITADAKITAI NO DESU GA\ and as a result the example phrase 
YOYAKU O SHITE ITADAKITAI NO DESU GA' is determined to match the input phrase YOYAKU O SHITE ITADAKITAI 
GA\ 

25 In this way even if an input phrase does not match an example phrase completely it is possible to obtain an exam- 
ple phrase expressing the same meaning as the input phrase. That is. by taking grammatical attributes into considera- 
tion, it is possible to carry out processing in the converting part 7 ignoring the 'NO DESU* in the example phrase. 

Also, as a result of this, it becomes unnecessary to provide example phrases corresponding to superficial varia- 
tions; that is. it becomes unnecessary to store in the verb phrase translation example memory 9 as example phrases in 

30 addition to the verb phrase YOYAKU O SHITE ITADAKITAI NO DESU GA* the verb phrase YOYAKU O SH ITE ITADAK- 
ITAI GA' with the 'NO DESU' removed, the verb phrase YOYAKU O SHITE ITADAKITAI DESU GA' with the 'NO' 
removed or the verb phrase YOYAKU O SHITE ITADAKITAI 'N DESU GA' wherein the 'NO' has been changed to "N\ 
and therefore example phrases can be stored in the noun phrase translation example memory 8, the verb phrase trans- 
lation example memory 9 and the other translation example memory 10 efficiently. Also, the noun phrase translation 

35 example memory 8, the verb phrase translation example memory 9 and the other translation example memory 10 can 
be called a data base of example phrases, and when the approach described above is adopted it becomes possible to 
carry out the production, maintenance and improvement of this data base easily 

When on the other hand it is determined in the step S6 that no example phrase in the noun phrase translation 
example memory 8, the verb phrase translation example memory 9 or the other translation example memory 10 

40 matches an input phrase (a phrase supplied from the simple syntax analyzing part 6), processing proceeds to a step 
S8 and the converting part 7, by controlling the similarity degree calculating part 11, causes word similarity degrees to 
be calculated and on the basis of these word similarity degrees and other parameters computes translation suitabilities, 
which will be further discussed later, expressing the similarity (in meaning) between the input phrase and each of the 
example phrases stored in the noun phrase translation example memory 8. the verb phrase translation example mem- 

45 ory 9 or the other translation example memory 1 0. The converting part 7 then detects the example phrase of which the 
translation suitability is the highest and processing proceeds to a step S9. 

In the step S9. the converting part 7 produces a translation (hereinafter for convenience called an input phrase 
translation) of the input phrase on the basis of the translation corresponding to the example phrase detected in the step 
S8 and with reference to the translation dictionary 13. and outputs it to the phrase compounding part 14 together with 

so the clause syntax information from the simple syntax analyzing part 6. 

Here, the processing of the aforementioned steps S6 through S9 is carried out with respect to the example phrases 
stored in either the noun phrase translation example memory 8. the verb phrase translation example memory 9 or the 
other translation example memory 10, depending on whether the input phrase is a noun phrase, a verb phrase or an 
other phrase respectively. Therefore, because the example phrases that are made objects of processing are limited 

55 according to the type of the input phrase, it is possible to increase the translation processing speed. 

When the phrase compounding part 14 has received translations (input phrase translations) of all the input phrases 
constituting a certain clause, in a step S10 it generates a clause of the second language by compounding these input 
phrases on the basis of clause syntax information also supplied from the converting part 7 and supplies it to the clause 
compounding part 15. 
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After that, processing proceeds to a step S1 1 and the clause compounding part 1 5 determines whether or not the 
first language sentence is made up of a plurality of clauses. When in the step S1 1 it is determined that the first language 
sentence is made up of a plurality of clauses, that is, when a plurality of clauses (second language clauses) have been 
supplied to the clause compounding part 15 from the phrase compounding part 14, or when clauses have been sup- 

5 plied to the clause compounding part 15 from both the clause dividing part 4 and the phrase compounding part 14, 
processing proceeds to a step S12 and the clause compounding part 15 generates a second language sentence by 
compounding these clauses and supplies it to the outputting part 15, and then processing proceeds to a step Si 3. 

When in the step Si 1 it is determined that the first language sentence is not made up of a plurality of clauses. That 
is. when only one clause has been supplied to the clause compounding part 1 5 from the phrase compounding part 1 4, 

io the clause compounding part 15 supplies this clause (a second language sentence) unchanged to the outputting part 
16 and processing skips the step Si 2 and proceeds to the step S13. In the step Si 3, the second language sentence 
supplied from the clause compounding part 15 is outputted, and processing ends. 

Because, as described above, in the clause dividing part 4 and the simple syntax analyzing part 6 the first language 
sentence is divided in stages first into clauses, which are large syntax units, and then into phrases, which are small syn- 

15 tax units, and translation of the syntax units obtained at each stage, i.e. clauses and phrases, is carried out using exam- 
ples, compared to a case wherein translation of the entire first language sentence is carried out in one stage, it is 
possible to increase the translation processing speed. 

In the case described above, division of the first language sentence into clauses is carried out when there is among 
the clauses constituting the first language sentence a clause which matches a clause unit example stored in the clause 

20 pattern translation example memory 5 and on the basis of this clause; however, division into clauses can also be carried 
out irrespective of this kind of condition 

Next, the processing carried out by the translating apparatus of Fig. 5 when for example 'DEKIMASHITARA 
ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' ('If possible, may I have some strawberry ice cream 7) 
is inputted will be described with reference to Figs. 8A through 10C. 

25 By morpheme analysis being carried out in the inputting part 1 , for example the kind of morpheme information 
shown in Fig. 8A is extracted from this first language sentence 'DEKIMASHITARA ICHIGO NO AISU KUREEMU O 
ONEGAI SHITAI 'N DESU GA\ In Fig. 8A. for reference, modality case information in the grammatical attributes of the 
first language sentence is also shown. 

The first language sentence 'DEKIMASHITARA ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' 

30 and its morpheme information are supplied from the inputting part 1 to the collating part 2. Now, assuming that 'DEKI- 
MASHITARA ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' is not stored as an example in the set 
phrase translation example memory 3, the first language sentence 'DEKIMASHITARA ICHIGO NO AISU KUREEMU O 
ONEGAI SHITAI 'N DESU GA' and its morpheme information are supplied from the collating part 2 to the clause divid- 
ing part 4. 

35 In the clause dividing part 4, collation of the first language sentence 'DEKIMASHITARA ICHIGO NO AISU 
KUREEMU O ONEGAI SHITAI 'N DESU GA' with the clause unit examples stored in the clause pattern translation 
example memory 5 is carried out. Here, supposing now that for example translation example data of the kind shown in 
Fig. 8B made up of an example 'DEKIMASHITARA X' and its translation 'X, if possible* are stored in correspondence 
with each other in the clause pattern translation example memory 5, because in the first language sentence 'DEKIM AS- 

40 HITARA ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' there is a clause matching the example 'DEKI- 
MASHITARA' (in this case, 'ICHIGO NO AISU KUREEMU O ONEGAI SHITAI *N DESU GA' is recognized as matching 
the X part), the first language sentence 'DEKIMASHITARA ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU 
GA' is divided up in the clause dividing part 4 into the clauses 'DEKIMASHITARA' and 'ICHIGO NO AISU KUREEMU 
O ONEGAI SHITAI 'N DESU GA'. 

45 The translation 'X, if possible' corresponding to the clause 'DEKIMASHITARA' matching a clause unit example 
stored in the clause pattern translation example memory 5 is then supplied from the clause dividing part 4 to the clause 
compounding part 15. Also, the remaining clause of the first language sentence, 'ICHIGO NO AISU KUREEMU O 
ONEGAI SHITAI 'N DESU GA', is supplied from the clause dividing part 4 to the simple syntax analyzing part 6. 

In the simple syntax analyzing part 6. by the syntax of the clause 'ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 

so 'N DESU GA' being analyzed, it is recognized that 'ICHIGO NO AISU KUREEMU O' constitutes one noun phrase and 
'ONEGAI SHITAI 'N DESU GA' constitutes one verb phrase. Also, in this case, it is recognized that the noun phrase 
'AISU KUREEMU O' is the object of the verb phrase 'ONEGAI SHITAI 'N DESU GA'. On the basis of these recognition 
results, the clause 'ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA* is divided into phrase units. 

Here, for example although the translation of the verb TORU' in the sentence 'OKANE O TORU' ('to take money') 

55 is 'take' or 'get', the translation of the verb TORU' in the sentence 'CHOUSHOKU O TORU' ('to have breakfast') is 'have' 
or 'eat'. Thus with a verb (or a verb phrase) it is sometimes difficult to determine its translation if the object, subject or 
complement is not known. For this reason, in the simple syntax analyzing part 6, in cases like this, when necessary an 
object, subject or complement or the like is included with the verb (predicative part) to make one verb phrase. 

That is, in this case, the clause 'ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' is divided into the 
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noun phrase 'ICHIGO NO AiSU KUREEMU O' and the verb phrase, including an object, of 'AISU KUREEMU O 
OMEGAI SHITAI 'N DESU GA'. 

Also, in the simple syntax analyzing part 6, grammatical attributes of the phrases are generated (recognized) and 
assigned to the phrases. 

• 5 That is, for the verb phrase 'ICHIGO NO AISU KUREEMU 0\ for example slot-name values to the effect that 

'ICHIGO NO' is a modifier of 'AISU KUREEMU O' and 'AISU KUREEMU O' is modified by 'ICHIGO NO* are produced 
(however, because in this case these grammatical attributes are not used in subsequent processing they will not be 
referred to particularly in the following). 

Also, for the verb phrase 'AISU KUREEMU O ONEGAI SHITAI 'N DESU GA\ as shown in Fig. 9A, a slot-name 
10 value (root ONEGAI SURU' + desiderative) meaning that 'ONEGAI SHITAI 'N DESU GA' is a desiderative form of the 
root 'ONEGAI SURU* and a slot-name value (NP1 'AISU KUREEMU O') meaning that its object is ice cream (a food) 
are produced. 

The noun phrase 'ICHIGO NO AISU KUREEMU O' and the verb phrase 'AISU KUREEMU O ONEGAI SHITAI 'N 
DESU GA' and their grammatical attributes thus obtained are supplied from the simple syntax analyzing part 6 to the 
15 converting part 7. 

In the converting part 7. each of the phrases supplied from the simple syntax analyzing part 6 and the stored con- 
tent of the noun phrase translation example memory 8, the verb phrase translation example memory 9 or the other 
translation example memory 10 are collated and the example phrases most similar to the phrases supplied from the 
simple syntax analyzing part 6 are detected (searched) from the noun phrase translation example memory 8, the verb 

20 phrase translation example memory 9 or the other translation example memory 10. 

That is, when for instance in the verb phrase translation example memory 9 the example TANAKA SAN O ONEGAI 
SHITAI *N DESU GA' ('Mr. Tanaka. please') is stored in association with the slot-name values (root 'ONEGAI SURU' + 
desiderative) and NP1 TANAKA SAN O' and also in correspondence with the translation of this, 'may I speak to NP1 ?, 
as shown in Fig. 9B. and the example KOUHEE O IPPAI ONEGAI SHITAI 'N DESU GA' is stored in association with 

25 the slot-names (root 'ONEGAI SURU' + desiderative) and NP1 'KOUHEE O IPPAI* and also in correspondence with the 
translation of this, 'may I have NP1 ?\ as shown in Fig. 9C, then from a comparison of the distance in meaning between 
the objects 'AISU KUREEMU O' and TANAKA SAN O' and the distance in meaning between the objects 'AISU 
KUREEMU 0' and 'KOUHEE O IPPAI', the example 'KOUHEE O IPPAI ONEGAI SHITAI 'N DESU GA' is detected as 
the example most similar to the verb phrase 'AISU KUREEMU O ONEGAI SHITAI 'N DESU GA. 

30 The translation 'may I have NP1 ?' corresponding to this example 'KOUHEE O IPPAI ONEGAI SHITAI 'N DESU GA' 
is then read from the verb phrase translation example memory 9 and supplied from the converting part 7 to the phrase 
compounding part 14 as the translation of the verb phrase 'AISU KUREEMU O ONEGAI SHITAI 'N DESU GA'. 

Also, in the converting part 7, supposing that for instance the example 'SAKUJ ITSU NO GYUUNYUU' and its trans- 
lation 'yesterday's milk', the example WATASHI NO HON' and its translation 'my book' and the example 'KOUHEE NO 

35 AISU KUREEMU' and its translation 'coffee flavored ice cream' are respectively stored in correspondence with each 
other in the noun phrase translation example memory 8, as shown in Fig. 10A, KOUHEE NO AISU KUREEMU' is 
detected as the example most similar to the noun phrase 'ICHIGO NO AISU KUREEMU O' from the simple syntax ana- 
lyzing part 6, and the translation 'coffee flavored ice cream' corresponding to this is read from the noun phrase transla- 
tion example memory 8 

40 In thus case, in the converting part 7 it is recognized that in the noun phrase 'ICHIGO NO AISU KUREEMU O' the 
'KOUHEE* in the example 'KOUHEE NO AISU KUREEMU' has become 'ICHIGO', and 'ICHIGO'. which is not in the 
example, is found up by referring to the translation dictionary 13. 

Here, it will be assumed that 'ICHIGO' and its translation 'strawberry' are stored in correspondence with each other 
in the translation dictionary 13 as shown in Fig. 10B. 
45 When the converting part 7 finds 'ICHIGO' in the translation dictionary 1 3, it reads out the 'strawberry' stored in cor- 
respondence with it. Then, the translation 'coffee' of the 'KOUHEE', corresponding to 'ICHIGO'. in the translation 'coffee 
flavored ice cream' read from the noun phrase translation example memory 8, is replaced with the 'strawberry' read 
from the translation dictionary 13, and the translation 'strawberry flavored ice cream' of the noun phrase 'ICHIGO NO 
AISU KUREEMU O' is thereby generated. This translation 'strawberry flavored ice cream' is supplied from the convert- 
so ing part 7 to the phrase compounding part 14. 

In the phrase compounding part 14, the translation 'strawberry flavored ice cream' of the noun phrase 'ICHIGO NO 
AISU KUREEMU O' and the translation 'may I have NP1 ?' of the verb phrase 'AISU KUREEMU O ONEGAI SHITAI 'N 
DESU GA' are compounded and the translation 'may I have strawberry flavored ice cream?' of the clause 'ICHIGO NO 
AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' is thereby generated, and this is supplied to the clause compound- 
55 ing part 15. 

When the clause compounding part 15 receives the translation 'may I have strawberry flavored ice cream?' of the 
clause 'ICHIGO NO AISU KUREEMU O ONEGAI SHITAI 'N DESU GA' and the translation 'X. if possible' of the clause 
'DEKIMASHITARA', it compounds them. In this way. the second language sentence 'may I have strawberry flavored ice 
cream, if possible?', consisting of the first language sentence 'DEKIMASHITARA ICHIGO NO AISU KUREEMU O 
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ONEGA! SHITAI 'N DESU GA' translated into the second language, is generated. 

Next, the method of detection of the example phrases most similar to the input phrases used in the converting part 
7 will be described in detail. Now, the words constituting an input phrase I will be expressed, from the beginning of the 
phrase, as iw 1( iw 2 , • • • . iw N , and their slot-name values will be expressed as if 1t rf 2 . • • • , if Q . Similarly, the words 

5 constituting an example phrase E will be expressed, from the beginning of the phrase, as ew 1t ew 2 , • • • . ew M , and 
their slot-name values will be expressed as ef lf ef 2 . • • • . ef P Here, M and N respectively are the numbers of words 
constituting the example phrase E and the input phrase I, and P and Q respectively are the numbers of grammatical 
attributes of (extracted from) the example phrase E and the input phrase I. 

The example most similar (similar in meaning) to an input phrase is the one most suitable to be used in translation 

10 processing of that input phrase. Now, if the probability of a certain example phrase E being suitable for translation of an 
input phrase I is called its translation suitability, this translation suitability can be expressed as a conditional probability 
of the example phrase as P(Examp!e|lnput). Here. P() expresses probability and Example and Input respectively mean 
a set of example phrases and a set of input phrases. 

The example phrase most similar to an input phrase is that for which this translation suitability P(Example|lnput) is 

75 the highest, and when this is written E max , this example phrase E max can be obtained from Exp. (2). 

E max= max E€ Example[P(E|l)] (2) 

The right side of Exp. (2) means an operation obtaining the E for which the value inside the Q is a maximum. 
20 The translation suitability P(Example| Input) can be expressed according to Bayes law as shown in Exp. (3). 

P(Example|lnput)=P(Example)P(lnput|Example)/P(lnput) (3) 

Here, when finding the example phrase E (E max ) most similar to a certain input phrase I. because there is only one 
25 input phrase I, that is, Input = I, the denominator P(lnput) of Exp. (3) is 1 and can be ignored. Therefore, from Exp. (2) 
and Exp. (3), it is possible to obtain the example phrase E max most similar to the input phrase I using the following Exp. 
(4). 

E max =max Ee Example[P(E)P(l|E)] (4) 

30 

From Exp. (4), to obtain the example phrase having the greatest translation suitability with respect to the input 
phrase, it is necessary to obtain the probabilities P(E) and P(I|E). 

Here, the probability P(E) represents the priori probability of the example E (E€ Example) being used for translation. 
The probability (conditional probability) P(I|E) represents the probability (hereinafter for convenience referred to as the 
35 transformation probability) of the example phrase E being transformed into the input phrase I and used. 

The priori probability P(E) must correspond to the suitability of the example phrase E being used in any input 
phrase, and therefore should for example reflect the following kinds of factor. That is. first it is necessary to reflect in the 
priori probability P(E) the factor of what kinds of expression are frequently used in the domain (the type of expression 
(writing) inputted into the translating apparatus (for example writing appearing in machine manuals, or newspaper arti- 
40 cles)) in which the translating apparatus is to be applied. 

Specifically, example phrases E corresponding to expressions frequently used in the domain must be given higher 
priori probabilities P(E) than example phrases E corresponding to expressions only rarely used and expressions having 
meaning content having little relation to the domain. 

Next, it is necessary to reflect in the priori probability P(E) the factor of what other example phrases are stored in 
45 the translating apparatus besides that example phrase E (in the translating apparatus of Fig. 5. because the example 
phrases are divided into noun phrases, verb phrases and other phrases and respectively stored in the noun phrase 
translation example memory 8, the verb phrase translation example memory 9 and the other translation example mem- 
ory 10, depending on whether the input phrase is a noun phrase, a verb phrase or an other phrase this becomes the 
factor of what kinds of example phrases are stored in the noun phrase translation example memory 8, the verb phrase 
so translation example memory 9 or the other translation example memory 10). Specifically, for example it is necessary to 
give to extremely general example phrases E of which there are almost no other similar example phrases a higher priori 
probability P(E) than special example phrases and example phrases of which there are many similar example phrases. 

A priori probability P(E) in which these kinds of factor are suitably reflected can for example be obtained using cor- 
pus data (training corpus data), which is a set of language expressions typically used in the domain in which the trans- 
55 lating apparatus is to be applied. 

That is. for example accurately selecting from among the example phrases stored in the translating apparatus 
those example phrases which are most suitable for translating corpus data is carried out manually or by other means 
for all the corpus data. In this case, if the number of example phrases stored in the translating apparatus is expressed 
N E , the total number of times a selection is made from among these example phrases is expressed T and the number 



13 

BXSDCCID <EP_ OE05403A2J_> 



EP 0 805 403 A2 



of times an example Ej (i = 1, 2, • • • , Ng) is selected is expressed freq (Ej). it is possible to obtain the priori probability 
P(Ej) for each example Ej for instance from Exp. (5). 

P(E,)^ (5) 



Here, when selecting the example phrases most suitable for translation of corpus data manually is problematic, it 
is possible to obtain approximate values of the priori probability P(Ej) in Exp. (5) by making the translating apparatus 
10 translate the corpus data. 

That is. as shown in the flow chart of Fig. 1 1 . first, in a step S21, the priori probabilities P(Ej) are all initialized to for 
example 1/N E . Then, in a step S22, using this priori probability P(Ej). the translating apparatus of Fig. 5 is made to trans- 
late all the corpus data, and at this time the number of times F(Ej) that each example phrase (Ej) is used is counted. 
Then, in a step S23, the priori probabilities P(Ej) are renewed for example according to the expression P(E s ) = F(E j)/£ . 
15 where £ is the summation of F(Ej) over i = 1 to IM E . 

After the priori probability P(E|) has been renewed for all the example phrases E if processing proceeds to a step 

524 and detects the example phrase E i(rxiaX ) given the greatest priori probability. Processing then proceeds to a step 

525 and determines whether or not the priori probability P(E i(max) ) of the example phrase E i(max) is smaller than a pre- 
determined threshold value, and when it is not smaller returns to the step S22 and repeats the steps S22 through S25. 

20 When the priori probability (E i(max) ) is smaller than the predetermined threshold value, the priori probabilities (Ej) at that 
time are outputted as the priori probabilities for the example phrases E } and processing ends. 

When obtaining corpus data is problematic, it is also possible for example to obtain priori probabilities P(Ej) in the 
following way using the example phrases stored in the translating apparatus. 

That is, if among the words constituting an example phrase E| for which a priori probability P(Ej) is to be obtained 

25 the number of words that match words constituting another example phrase is expressed W N and among the slot- 
names of the example phrase (Ej) the number of slot-names had by another example is expressed F N , the generality of 
that example phrase E jt or its similarity sim-score (Ej) to other examples, can for example be estimated as (W N +F N )/(the 
number of words constituting the example phrase E,). In this case, the priori probability P(Ej) can for example be 
obtained according to Exp. (6). 

30 

v 17 sim-score(E j) n e 

jLsim-score(Ej) 

35 

Next, the transformation probability P(I|E) can be obtained in the following way. When a user expresses the mean- 
ing content of an example phrase E, it can be considered that with a certain high probability the user will use an expres- 
sion with words and phrases the same as the example phrase E. with a slightly lower probability the user will use an 

40 expression only slightly different from the example phrase E and with a lower probability the user will use an expression 
greatly different from the example phrase E. 

Therefore, the input phrase I can be regarded as a variation produced as a result of the expression of the example 
phrase E being distorted in the language production process of the user. In this connection, the following kinds of trans- 
forming operators for transforming (distorting) the example phrase E will be introduced. 

45 That is. as operators operating on the words constituting the example phrase E, a word copying operator echo-word 
(ewm.iwn), a word deleting operator delete-word(ew m ), a word inserting operator add-wordOwJ and a word replacing 
operator alter-wordCew^.iWn) will be introduced. Also, as operators operating on the slot-name values of the example 
phrase E. a slot-name value copying operator echo-feature(efp,if q ). a slot-name value deleting operator delete-fea- 
ture(efp), a slot-name value inserting operator add-feature('rf q ) and a slot-name value replacing operator alter-fea- 

50 ture(efpjf q ) will be introduced. 

Here, the word copying operator echo^wordCeWro.iwJ is an operator which without changing it makes the mth (mth 
from the beginning) word ew m of the example phrase E the nth word iw n of the input phrase I. The word deleting oper- 
ator delete-word(ew m ) is an operator which deletes the mth word ew m of the example phrase E. The word inserting 
operator is an operator which inserts (adds) the nth word iw n of the input phrase I to the example phrase E. The word 

55 replacing operator alter-wordfewm.iwn) is an operator which replaces the mth word ew m of the example phrase E with 
the nth word iw n of the input phrase I (here, the word iw n is close in meaning to but different from the word ew m ). 

The slot-name value copying operator echo-feature(ef p ,if q ) is an operator which without changing it makes the pth 
slot-name value of the example phrase E (in the case of slot-name values, their position in the phrase does not partic- 
ularly affect processing and therefore here the order of the slot-name values is a matter of convenience) the qth slot- 
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name value if q of the input phrase I. The slot-name value deleting operator ds!ete-feature(ef p ) is an operator which 
deletes the pth slot-name value ef p of the example phrase E. The slot-name value inserting operator add-feature(if q ) is 
an operator which inserts the qth slot-name value if q of the input phrase I into the example phrase E. The slot-name 
value replacing operator alter-feature(efp,if q ) is an operator which replaces the pth slot-name value of the example 
phrase E with the qth slot-name value if q of the input phrase I (here, the slot-name value if q is close in meaning to but 
different from the slot-name value ef p ). 

Now, if the aforementioned transforming operators as a whole are expressed distort 2 and that which is obtained by 
2 transforming operators distort-,, distort 2 , • • • , distort 2 being applied to the example phrase E is the input phrase I, 
the input phrase I can be defined as the set of these transforming operators, as shown in Exp. (7). 

^{distort, , distort 2 . * - * .distort^ (7) 

There may be more than one way of transforming the example phrase E into the input phrase 1. but here it is suffi- 
cient to consider just a transformation following a most probable direct route. 

From Exp. (7), the transformation probability P(I|E) can be expressed as shown in Exp. (8). 

P(l|E)=P({distort 1 ,distort 2 , • • • ,distort 2 }|E) (8) 

Here, as shown in Exp. (9), the transforming operators can each be regarded as independent. 

P(distort k |distort v distort 2 , • • • • .distort z ;E)«P(distort k |E) (9) 

Therefore, from Exp. (9), Exp. (8) can be simplified as shown in Exp. (10) and as a result the transformation prob- 
ability P(I|E) becomes as shown in Exp. (11). 

z 

P({distort v distort 2 , • • • • .distort 2 }|E)« J-]P(distort z |E) (10) 

Z«1 

z 

P(l|E)«f]P(distort 2 |E) (11) 

z=1 



Also, because the example phrase E can be expressed as the set of the words ew m (m = 1, 2, • • • , M) and the 
slot-name values ef p (p = 1, 2. • • • , P). Exp. (11) becomes as shown in Exp. (12). 

z 

P(l|E)«j~[P(distort z |ew 1 ,ew 2 , • • • • ,ew M ;ef v ef 2 , • • • *,ef P ) (12) 

23 1 



From Exp. (12), if the probability P(distory ew 1t ew 2 , * • • ,ew M ; ef 1 ,ef2, • • • ,ef P ) is known for the cases wherein 
the transforming operator distort k is respectively the word copying operator echo-word(ew m ,iw n ), the word deleting 
operator delete-word(ew m ), the word inserting operator add-word(iw n ), the word replacing operator alter- 
wordfewm.iwn), the slot-name value copying operator echo-feature(ef p ,if q ), the slot-name value deleting operator 
delete-feature(efp). the slot-name value inserting operator add-feature(ifq) or the slot-name value replacing operator 
alter-feature(ef p ,if q ). the transformation probability P(I|E) can be obtained. 

Here, the following assumptions can be made about the transforming operators, and as a result it is possible to sim- 
plify the probability Pfdistortfcl ew 1 ,ew 2 ,« • • ,ew M ; ef 1t ef 2 , • • • ,ef P ) for each of the transforming operators. 

That is, in the case of the word copying operator echo-word(ew m ,iw n ). the probability of the mth word ew m of the 
example phrase E being made the nth word iw n of the input phrase I without being changed can be assumed to depend 
only on these words ew m , iw n . Therefore, the probability P(echo-word(ew m ,iw n )| ew 1( ew 2f • • • ,ew M ; ef^ef^ • • • ,ef P ) 
can be simplified as shown in Exp. (13). 

P(echo-word(ew m ,iw n )|ew 1 ,ew 2f • • ,ew M ;ef v ef 2 , • • ,ef P ))« P(echo-word(ew m ,iw n )) (13) 

Because the probability shown in Exp. (13) is the probability of the word ew m being as it were copied as a word of the 
input phrase I without being changed, hereinafter it will for convenience be referred to as the word copy probability. 
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In the case of the word deleting operator delete-worcKew™), it can be assumed that the probability of the mth word 
ew m of the example phrase E being deleted depends only on that word ew m . Therefore, the probability P(de!ete- 
word(ew m )| ew^e^, • * • .ew M ; ef 1 ,ef 2 . • • • ,ef P ) can be simplified as shown in Exp. (14). 

-s P(delete-word(ew m )|ew 1t ew 2 , • • ,ew M ;ef 1( ef 2 . • • ,ef P ))«P(delete-word(ew J) (14) 

Because the probability shown in Exp. (14) is the probability of the word ew m being deleted, hereinafter it will for con- 
venience be referred to as the word deletion probability. 

In the case of the word inserting operator add-wordfrWn), it can be assumed that the probability of the nth word iw n 
w of the input phrase I being inserted into the example phrase E depends only on that word iw m . Therefore, the probability 
P(add-word(iw n )| ew 1 ,ew 2 , • • • ,ew M ; ef 1 .ef 2 . • • • ,ef P ) can be simplified as shown in Exp. (15). 

P(add-wordOw n )|ew 1t ew 2 , • • .ew M ;ef v ef 2 , • • ,ef p ))«P(add-word(iw n )) (15) 

is Because the probability shown in Exp. (15) is the probability of the word iw n being inserted (added), hereinafter it will 
for convenience be referred to as the word insertion probability (or the word addition probability). 

In the case of the word replacing operator alter-worcKew^.iwn), it can be assumed that the probability of the mth 
word ew m of the example phrase E being replaced with the nth word iw n of the input phrase I depends only on those 
words ew m and iw n . Therefore, the probability P(alter-word(ew m ,iw n )| ew 1 ,ew 2 , • • • ,ew M ; ef 1( ef 2 . - • • ,ef P ) can be sim- 

20 plif ied as shown in Exp. (1 6). 

P(arter-word(ew m ,iw n )|ew 1 ,ew 2 . • • ,ew M ;ef v ef 2 . • • ,ef P ))«P(alter-word(ew m ,iw n )) (16) 

Because the probability shown in Exp. (16) is the probability of the word ew m being replaced with the word iw n . herein- 

25 after it will for convenience be referred to as the word replacement probability. 

Also in the cases of the slot-name value copying operator echc-featurefefp/rfq). the slot-name value deleting oper- 
ator delete-feature(efp). the slot-name value inserting operator add-feature(if q ) and the slot-name value replacing oper- 
ator alter-feature(ef p .if q ) expressing copying, deleting, inserting and replacing of slot-name values, the same 
assumptions can be made as when the words in the word copying operator echo-word(ew m .iw n ). the word deleting 

30 operator delete-word(ew m ), the word inserting operator add-word(iwn) and the word replacing operator alter- 
word(ew m ,iwn) expressing copying, deleting, inserting and replacing of words are replaced with slot-name values. 

As a result, the probability of the slot-name value ef p being copied (hereinafter for convenience referred to as the 
slot-name value copy probability) P(echo-feature(ef p ,if q )| ew 1 .ew 2 , • • • ,ew M ; ef^efg, • • • .ef P ), the probability of the 
slot-name value ef p being deleted (hereinafter for convenience referred to as the slot-name value deletion probability) 

35 P(delete-feature(efp)| ew 1( ew 2 , • • • ,ew M ; ef 1t ef 2 . • • - .ef?), the probability of the slot-name value rf q being inserted 
(hereinafter for convenience referred to as the slot-name value insertion probability) P(add-feature(if q )| 
ew 1t ew 2 . • • • ,ew M ; ef-i.ef^ • • • ,ef P ) and the probability of the slot-name value ef p being replaced with the slot-name 
value if q (hereinafter for convenience referred to as the slot-name value replacement probability) P(alter-feature(efp,if q )| 
ew 1t ew 2 , • • • ,ew M ; ef 1t ef 2 , • • • ,ef P ) can respectively be simplified as shown in Exps. (17) through (20). 

40 

P(echo-feature(ef p .rf q )|ew 1 ,ew 2 , • • ,ew M ;ef v ef 2 . • • ,ef P ))« P(echo-feature(ef p .if q )) (17) 
P(delete-feature(ef p )|ew 1 ,ew 2 , • • ,ew M ;ef n .ef 2 . • • ,ef p ))«P(delete-feature(ef p )) (18) 
45 P(add-feature(if q )|ew 1 ,ew 2 . • • . ew M ;ef , .ef 2 , • • ,ef p ))«P(add-feature(if q )) (19) 

P(alter-feature(ef pt if q )|ew 1 ,ew 2f • • ,ew M ;ef 1t ef 2 . • • ,ef P ))«P(alter-feature(ef p ,if q )) (20) 

From the above, if the word copying operator echo-word(ew m ,rw n ), the word deleting operator delete-word(ew m ). 

so the word inserting operator add-word('rw n ) and the word replacing operator alter- word(ew m ,iw n ), which are transforming 
operators for words (and hereinafter for convenience referred to as word transforming operators), are expressed as a 
whole as distort-word x (ew m ,iw n ) and the slot-name value copying operator echo-featurefefpifq). the slot-name value 
deleting operator delete-feature(ef p ). the slot-name value inserting operator add-feature(rf q ) and the slot-name value 
replacing operator alter-featurefefp.ifq). which are transforming operators for slot-name values (and hereinafter for con- 

55 venience referred to as slot-name value transforming operators) are expressed as a whole as distort-feature y (ef p .rf q ). 
the transformation probability P(I|E) expressed in Exp. (11) can be expressed with the product of the transformation 
probabilities (hereinafter for convenience referred to as the word transformation probability) P(distort-word x (ew m ,iw n )) 
of the word transforming operator distort-word x (ew mi iw n ). and the product of the transformation probabilities (hereinaf- 
ter for convenience referred to as the slot-name value transformation probabilities) P(distort-feature y (ef p ,if q )) of the stot- 
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name value transforming operator distort-feature y (ef p ,if q ). 

x Y 
P(!|E)«p| P(distort-word x (ew m ,iw n ))]"^ P(distort-feature q (ef p .if q )) (21 ) 

Here, X and Y respectively are the total numbers of word transforming operators and slot-name value transforming 
operators applied, and X+Y = Z (Exp. 11)). 

Next, the methods by which the word copy probability P(echo-word(ew m ,iw n )), the word deletion probability 

w P(delete-word(ew m )), the word insertion probability P(add-word(iw n )), the word replacement probability P(alter- 
word(ew m ,iw n )) ( and the slot-name value copy probability P(echo-feature(efp,if q )), the slot-name value deletion proba- 
bility P(delete-feature(ef p )) f the slot-name value insertion probability P(add-feature(if q )) and the slot-name value 
replacement probability P(aiter-feature(efp,if q )) are calculated will be described. 

First, the word copy probability P(echo-word(ew m ,iw n )), the word deletion probability P(delete-word(ew m )) and the 

is word insertion probability Pfadd-wordflWn)) can be regarded as reflecting human language production behavior. That 
is, some types of word have a greater or lesser probability of being copied, deleted or inserted than other words. There- 
fore, when corpus data of the domain in which the translating apparatus is to be applied is available, it is possible to 
compute distributions of the probability of words being copied, deleted or replaced from corpus data and thereby obtain 
the word copy probability P(echo-word(ew m ,iw n )), the word deletion probability P(delete-word(ew m )) and the word 

20 insertion probability Pfadd-wordCiWp)). 

When on the other hand corpus data is CGfficult to obtain, on the basts of tendencies of words in language produc- 
tion (trends in the treatment of words (for example trends such as words tending to be used unchanged or tending to 
be deleted or inserted)), it is possible to classify words into a number of groups and give a word copying probability 
P(echo-word(ew m ,iw n )) t a word deletion probability P(delete-word(ew m )) and a word insertion probability P(add- 

25 word(iw n )) to each of these groups. 

In this preferred embodiment, words are classified into the four groups of strong independent words (for example 
verbs and nouns and so on); light independent words (for example adjectives and some adverbs (for example f MATA* 
('again') and the like); functional words (for example particles and conjunctions); and modifiers (for example adverbs 
expressing level (for example TOTEMO* (Very') (also including adjuncts), and constants of the kind shown in Exps. (22) 

30 through (24) are given as the word copy probability P(echo-word(ew m ,iw n )). the word deletion probability P (delete- 
word(ew m )) and the word insertion probability Pfadd-wordfrWn)-) respectively depending on which group the word to 
which the word transforming operator is to be applied belongs to. 



35 



40 



45 



P(echo-word(ew m ,iw n )) = echo-strong-content - when ew m 
is a strong independent word echo-light-content - when ew m 
is a light independent word echo-grammatical-function - when ew m 
; a functional word echo-modifier - when ew m is a modifier or an adjunct 



Here, echo-strong-content, echo-light-content, echo-grammatical-function and echo-modifier are predetermined con- 
stants between 0 and 1. The word copy probability P(echo-word(ew m ,iw n )) is given by Exp. (22) when the words ew m 
and iw m are the same; when they are not the same, it is made 0 (this is also the same in the case ol the slot-name value 
copy probability, which corresponds to the word copy probability). 

P(delete-word(ew m )) = delete-strong-content - when ew m 
is a strong independent word delete-light-content - when ew m 
is a light independent word delete-grammatical-function - when ew m ^ 23 ^ 
50 is a functional word delete-modif ier - when ew m is a modifier or an adjunct 



Here, delete-strong-content, delete-light-content, delete-grammatical-function and delete-modifier are predetermined 
constants between 0 and 1. 

55 
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P(add-word(iw n )) = add-strong-content - when iw n 
is a strong independent word add-light-content - when iw n 
is a light independent word add-grammatical-function - when iw n 
is a functional word add-modifier - when iw n is a modifier or an adjunct 



Here, add-strong-content, add-light-content, add-grammatical-function and add-modifier are predetermined constants 
between 0 and 1 . 

io In this preferred embodiment, in the same way. the slot-name value transformation probabilities, namely the slot- 
name value copy probability P(echo-feature(ef p ,rf q )), the slot-name value deletion probability P(delete-feature(ef p )). the 
slot-name value insertion probability P(add-feature(if q )) and the slot-name value replacement probability P(alter-fea- 
ture(efp.if q )). are also given as constants. 

Next, concerning the word replacement probability P(alter-word(ew m .iw n )), this can be computed on the bass of 

is the closeness in meaning between the words ew m and iw n . That is, if the word iw n and the word ew m are synonyms a 
high probability can be given as the word replacement probability P(alter-word(ew m .iw n )). if the word iw n and the word 
ew m are similar in meaning a slightly lower probability, and when the word iw n and the word ew m are unrelated then a 
lower probability can be given to the word replacement probability Pfalter-wordCewm.iWp)). 

This kind of probability distribution relating to the words ew m and tw n can be obtained using corpus data. That is, 

20 using context similarity, when two words are used in similar contexts in the corpus data, the similarity between these 
two words can be regarded as being high, and when they are used in different contexts the similarity between two words 
can be regarded as being low. The two words having a high similarity can be given a high word replacement probability. 

When on the other hand corpus data is difficult to obtain, it is possible to compute word replacement probabilities 
for example using a thesaurus of the kind shown in Fig. 6. 

25 Here, in the thesaurus, distances in meaning between two words are reflected as the amount of information 
included by the concept (parent node) common to the two words. That is. when the common concept is an extremely 
general one like for example 'thing', it is not possible to obtain from that concept information relating to a specific word 
that it includes, but when the common concept is a considerably limited concept like for example Vehicle with engine', 
it is possible to obtain from the concept much information relating to specific words that it includes. In other words, the 

30 amount of information included by a given concept (a node in the thesaurus) is inversely proportional to the number of 
words included in that concept (the number-dominated). 

Therefore, the word replacement probability P(alter-word(ew m ,iw n )) can be obtained from the amount of informa- 
tion included in the concept common to both the word ew m and the word rw n , that is. on the basis of the number of words 
included in that concept in the thesaurus, for example according to Exp. (25). 

35 

P(after-word(ew m ,ew n) - K x number <tominated(C(ew m , iw n )) > (25) 



40 In the above expression, K is defined as follows: 



K " L L number-dominated(C(ew m . iw n )) 

QW m € Vocabiw n € Vocab 

45 

Here. C(ew m .iWn) is a concept common to the words ew m and iw n , and number-dominated(C(ew m ,iw n )) is the number 
of words included in the concept C(ew m ,iWn) (words having the concept C(ew m .iw n ) as a higher concept). Vocab means 
the set of words in the thesaurus. Therefore, the first and second £ on the right side of Exp. (26) are respectively the 

so summations of the words ew m and iw n successively substituted for the words in the thesaurus. 

If a method like this wherein the distance between two words ew m and iw n is obtained on the basis of the amount 
of information included in a concept common to them is used, it is possible to accurately obtain the distance (relative 
distance) between the words irrespective of the structure of the thesaurus. That is, the thesaurus does not have to be 
constructed regularly, as it has been in the related art. and also the distances between concepts do not have to be the 

55 same. Also, the method can be applied both to thesauruses wherein words are classified minutely and to thesauruses 
wherein words are classified roughly it can also be applied to thesauruses wherein classification has been carried out 
minutely or roughly only in a part of the thesaurus. Furthermore, the thesaurus may be one dedicated to a certain spe- 
cific domain or may be a general one. 

The transformation probability P(I|E). as was shown above in Exp. (21). can be obtained as the product of the word 
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transformation probabilities P(distort-word x (ew m ,iw n )) and the product of the slot-name value transformation probabili- 
ties P(distort-word y (ef p ,rf q )). Of the product of the word transformation probabilities P(distort-word x (ew m ,iw n )) and the 
product of the slot-name value transformation probabilities P(distort-word y (ef p tf q )). the product of the slot-name value 
transformation probabilities P(distort-wordy(ef pf if q )) can be obtained relatively simply as the product of the slot-name 
5 value copy probabilities P(echo-feature(e1 p ,ifq)), the slot-name value deletion probabilities P(de!ete-feature(ef p )). the 
slot-name value insertion probabilities P(add-feature(if q )) and the slot-name value replacement probabilities P(after- 
feature(efpjf q )). 

That is, concerning grammatical attributes, the grammatical attributes of the input phrase (hereinafter for conven- 
ience referred to as the input attributes) and the grammatical attributes of the example phrase (hereinafter for conven- 

10 ience referred to as the example attributes) are compared, and example attributes the same as input attributes, 
example attributes not among the input attrtoutes, input attributes not among the example attributes, and example 
attributes which can be replaced with input attributes are detected. When there is an example attribute the same as an 
input attribute, an example attribute not among the input attributes, an input attribute not among the example attributes, 
or an example attribute which can be replaced with an input attribute, the slot-name value copy probability P(echo-fea- 

75 ture(ef p ,if q )), the slot-name value deletion probability P(delete-feature(ef p )), the slot-name value insertion probability 
P(add-feature(ifq)) or the slot-name value replacement probability P(alter-feature(ef p ,if q )) can be obtained (however, in 
this preferred embodiment, because as mentioned above these are all given as constants, it is not necessary to com- 
pute them), and by calculating their product it is posstole to obtain the product of the slot-name value transformation 
probabilities P(distort-word y (ef p ,if q )). 

20 Specifically, when for example the input phrase is YOYAKU O SHITAI NO DESU GA' and its slot-name values are 

(desiderative +) (extended-predicate +) (s-part GA) (formal +) and the example phrase is 'YOYAKU O SHITE ITADAKI- 
TAI NO DESU GA' and its slot-name values are (gerund-suffix ITADAKU) (desiderative +) (extended-predicate +) (s- 
part GA) (formal +), the slot-name values (desiderative +). (extended-predicate +), (s-part GA) and (formal +) are 
detected as example attributes the same as input attributes and the slot-name value (gerund-suffix ITADAKU) is 

25 detected as an example attribute not among the input phrase attributes. 

In this case, by calculating the product of the slot-name value copy probabilities P(echo-feature(efp.if q )) of the slot- 
name values (desiderative +). (extended-predicate +). (s-part GA) and (formal +) and the slot-name value deletion prob- 
ability P(delete-feature(ef p )) of the slot-name value (gerund-suffix ITADAKU) it is possible to obtain the product of the 
slot-name value transformation probabilities P(distort-word y (ef p if q )). 

30 In obtaining the product of the word transformation probabilities P(distort-word x (ew m ,iw n )), on the other hand, it is 
necessary to find the as it were most direct transformation route from the example phrase E to the input phrase I from 
among a number of transformation routes. 

That is, when for example 'KOKO Nt 3JI Nl DENWA SURU' as an example phrase E has been assigned the trans- 
lation 'call here at 3 o'clock', and this example phrase E is used in translation of the input phrase 'RESUTORAN Nl 

35 DENWA SURU', for example the following two transformation routes (transformation methods) are conceivable. 

Firstly, if with respect to the example phrase KOKO Nl 3JI Nl DENWA SURU'. from the first word. 'KOKO' is deleted, 
*NI' is deleted, '3JI' is replaced with 'RESUTORAN', 'Nl' is copied, 'DENWA* is copied. 'O' is inserted and 'SURU* is cop- 
ied, the input phrase 'RESUTORAN Nl DENWA SURU' is obtained. Therefore, in this case, in the translation 'call here 
at 3 o'clock', 'here' corresponding to 'KOKO Nl* is deleted. '3 o'clock* corresponding to '3JI' and "the restaurant* corre- 

40 sponding to 'RESUTORAN' are replaced, and the translation 'call at the restaurant' is obtained. 

Secondly, if with respect to the example phrase 'KOKO Nl 3JI Nl DENWA SURU'. from the first word, 'KOKO* is 
replaced with 'RESUTORAN*, 'Nl* is copied, '3JI' is deleted, 'Nl* is deleted, 'DENWA* is copied, 'O' is inserted and 
'SURU' is copied, then again the input phrase 'RESUTORAN Nl DENWA SURU' is obtained. In this case, in the trans- 
lation 'call here at 3 o'clock', 'here' corresponding to KOKO Nl' is replaced with the restaurant' corresponding to 'RESU- 

45 TORAN NT and 'at 3 o'clock' corresponding to *3JI Nl' is deleted, and the translation 'call the restaurant' is obtained. 

In this case, the translation 'call the restaurant*, obtained with the second transformation route, is correct, and there- 
fore, in obtaining the word transformation probability P(distort-word x (ew m ,iw n )), it is necessary to find the as it were 
most direct transformation route (hereinafter for convenience referred to as the optimum route) like this second trans- 
formation route. 

so To do this, even when the lengths of the example phrase E and the input phrase I are different, i.e. even when the 
example phrase E and the input phrase I consist of different numbers of words, it is necessary to recognize correspond- 
ing words and find the best correspondence relationship (alignment) between the example phrase E and the input 
phrase I and then find the set of most probably-correct transforming operators (word transforming operators) that 
should be applied to transformation of the example phrase E into the input phrase I. 

55 Now, if the set of word transforming operators is written Distort (={distort-word 1 (ew fn .iw n ), distort-wordafew^iWn), 
• • • , distort-word x (ew m ,iw n )J), the set Distort^* of most probably-correct word transforming operators (hereinafter for 
convenience referred to as the optimum word transforming operators) to be applied to transformation of the example 
phrase E into the input phrase I can be obtained using Exp. (27). 
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Distort max =max Dlslort [P(Distort|E.I)] (27) 

The right side of Exp. (27) means an operation for obtaining the Distort for which the value inside the Q is the maximum. 
Here, the set of optimum word transforming operators is obtained for example using DP (Dynamic Programming). 
•5 That is, first, to obtain from the probability P(Distort|E,l) the distance in DP, its negative log of -log(P(Distort|E,l)) is con- 
sidered. Now. writing D = -log(P(Distort|EJ)) , by assuming that the operators constituting the word transforming oper- 
ator set Distort are independent, D can be simplified as shown in Exp. (28). 

x 

10 D=-logJ^P(distort-word x (ew m ,iw n )|E,l) (28) 

x=1 



If it is assumed that the word transforming operators are independent from those words, among the words of the 
15 input phrase I, which they do not affect directly. Exp. (28) can be further simplified as shown in Exp. (29). 

x 

D=-log P(distort-word x (ew m ,iw n )|ew m .iw n ) (29) 

x=1 

20 

Dividing Exp. (29) for the individual transforming operators yields Exp. (30). 

x 

25 D= £ -log P(distort-word x (ew m ,iw n )) (30) 

Xa1 



The -log(P(distort-word x (ew m ,iw n ))) on the right hand side of Exp. (30) is the distance between the words ew m and 
30 iw n when the mth word ew m of he example phrase and the nth word iw n of the input phrase are made to correspond, 
and this can be seen as directly corresponding to individual penalties (weight on the path) (cost) used in dynamic pro- 
gramming equations. Therefore, if distort-word x (ew m ,iw n ) is rewritten as the word copying operator echo- 
worcKew^iWn), the word deleting operator delete-word(ew m ), the word inserting operator add-word(iw n ) and the word 
replacing operator a!ter-word(ew m ,iw n ) and the sum of the distances (the cumulative distance) of when as far as the mth 
35 word ew m of the example phrase and the nth word iw n of the input phrase are made to correspond is expressed G(m,n), 
this cumulative distance G(m,n) can be obtained regressively according to the gradualized expression shown in Exp. 
(31). 



40 



45 



G(m, n)=min a 



G(m-1, n-1) 
G(m, n— 1) 
G(m-1,n) 
G(m-1, n-1) 



logP(echo-word(ew m ,iw n )) 
!ogP(add-word(iw n )) 
logP(delete— word(eWfn)) 
IogP(aIter-word(ew fnt iw n ) 



(31) 



For the initial values, suitable values are assigned. 

so By calculating Exp. (31) for until for example m=M , it is possible to obtain the distance (the shortest distance) 
between the input phrase I and the example phrase E, and the path (DP path) obtained at that time shows the best (opti- 
mum) alignment between the input phrase I and the example phrase E, i.e. the optimum path. The set of word trans- 
forming operators which transform the example phrase E to match the input phrase I according to this optimum path 
(alignment) are the optimum word transforming operators. 

55 By adopting the approach described above, it is possible to obtain the set of optimum word transforming operators 
even when the lengths of the example phrase E and the input phrase I are different. 

Because the probability P(Distort|E,l) is the probability of a set of word transforming operators Distort being used 
to collate an input phrase I with an example phrase E and eliminate the differences in expression between the two, the 
probability mode! based on this probability can be called a stochastic expression collating model, and because the dis- 
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tance between the input phrase I and the example phrase E is obtained on the basis of this stochastic expression col- 
lating model it can be called a stochastic-expression-coilating-mode! -based distance. 

After the set of optimum word transforming operators is obtained in the way described above it is possible to obtain 
the product of the word transformation probabilities Pfdistort-wordxfewro.iWn)). and it is then possible to obtain the trans- 

5 formation probability P(1|E) from this and the product ol the slot-name value transformation probabilities P(distort- 
word y (efp,if q )) according to Exp. (21). By calculating the product of this transformation probability P(I|E) and the priori 
probability P(E) it is possible to obtain the translation suitability (P(I|E)P(E)) ( and the example phrase E of which this 
translation suitability is the greatest is the example phrase most similar to the input phrase I. 

In the converting part 7, the example phrase E most similar to the input phrase I is detected in the way described 

io above. That is, using a priori probability model and a transformation probability model respectively based on the priori 
probability P(E) and the transformation probability P(I|E), the example phrase E most similar to the input phrase I is 
detected. In this case, by using the transformation probability model, without excessively adding example phrases hav- 
ing superficial variations and omissions of particles and nouns and hesitations and so on in so-called spoken language 
to example phrases already prepared, it is possible to detect the example phrase most suitable for translating an input 

15 phrase, and as a result it is possible to increase the quality of translations. 

Next, with reference to the flow chart of Fig. 12, the processing in the converting part 7 by which the example 
phrase E most similar to the input phrase I is detected will be described further. It will be assumed that priori probabili- 
ties P(E) have been assigned to the example phrases E and are stored in the noun phrase translation example memory 
8, the verb phrase translation example memory 9 and the other translation example memory 10. It will be assumed also 

20 that the word copy probability P(echo-word(ew m ,iw rT )), the word deletion probability P(delete-word(ew m )) and the word 
insertion probability Pfadd-wordpWn)), and the slot-name value copy probability P(echo-feature(efp,if q )), the slot-name 
value deletion probability P(delete-feature(ef p )), the slot-name value insertion probability P(add-feature(if q )) and the 
slot-name value replacement probability P(alter-feature(ef p ,if q )) are given as constants and stored in a memory inside 
the converting part 7. Also, here, as an input phrase, it will be assumed that for example a noun phrase has been input- 

25 ted into the converting part 7 and that therefore processing will be carried out using only the example phrases stored in 
the noun phrase translation example memory 8. However, if a verb phrase or an other phrase is inputted into the con- 
verting part 7 as the input phrase, the only difference is that the example phrases used in the processing become those 
stored in either the verb phrase translation example memory 9 or the other translation example memory 10, and the 
processing method is the same as in the case of a noun phrase described in the following. 

30 When the converting part 7 receives an input phrase I (here, as mentioned above, a noun phrase), first, in a step 
S31 1 it reads an example phrase (a noun phrase) from the noun phrase translation example memory 8 (hereinafter, this 
read-out example phrase E will be called the focus example phrase). Also, in a step S32, the converting part 7 calcu- 
lates the transformation probability P(IIE) of the focus example phrase E with respect to the input phrase I, and then 
proceeds to a step S33. In the step S33, in the converting part 7, the probability P(E) assigned to the focus example 

35 phrase E is read from the noun phrase translation example memory 8, and this and the transformation probability P(l|E) 
calculated in the step S32 are multiplied together. In this way, the translation suitability of the focus example phrase E 
with respect to the input phrase I is obtained. 

After the translation suitability is obtained, proceeding to a step S34, the converting part 7 determines whether or 
not calculation of a translation suitability has been carried out for all the example phrases stored in the noun phrase 

40 translation example memory 8. When in the step S34 it is determined that calculation of a translation suitability has not 
been carried out for all the example phrases stored in the noun phrase translation example memory 8, processing 
returns to the step S31 , an example phrase E for which a translation suitability has not yet been calculated is read out 
from the noun phrase translation example memory 8, and the processing of the step S32 and the subsequent steps is 
repeated with this as the focus example phrase E. 

45 When on the other hand it is determined in the step S34 that calculation of a translation suitability has been carried 
out on all the example phrases stored in the noun phrase translation example memory 8. processing proceeds to a step 
S35, the example given the greatest translation suitability with respect to the input phrase I is detected in the converting 
part 7, and then processing ends. 

Next, the transformation probability calculation processing of the step S32 of Fig. 12 will be described with refer- 
so ence to the flow charts of Fig. 1 3 and Fig. 1 4. 

First, Fig. 13 is a flow chart illustrating the slot-name value transformation probability calculation processing. The 
converting part 7 first in a step S41 compares the input phrase I to the focus example phrase E and obtains slot-name 
value copy probabilities, slot-name value deletion probabilities, slot-name value insertion probabilities and slot-name 
value replacement probabilities. Then, in a step S42. the converting part 7 obtains a slot-name value transformation 

55 probability by multiplying these together, whereupon processing ends. 

Rg. 14 is a flow chart illustrating the word transformation probability calculation processing. The converting part 7 
first in a step S51 obtains the cumulative distance G(m,n) between the input phrase I and the focus example phrase E 
according to Exp. (31) and then proceeds to a step S52 and determines whether or not m is less than M (the number 
of words constituting the focus example phrase E). When in the step S52 it is determined that m is less than M, process- 
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ing returns to the step S51 and the converting part 7 increases m and calculates Exp. (31) while changing n. Then, in 
the step S52, when it is determined that m is not less than M, i.e. when m is equal to M, the path of when the cumulative 
distance G(m,n) was obtained, i.e. the optimum path, is detected and processing proceeds to a step S53. 

In the step S53, in the converting part 7, the word transformation probability is calculated following the obtained 
•5 optimum path. That is, word copy probabilities, word deletion probabilities, word insertion probabilities and word 
replacement probabilities are obtained and by these being multiplied together the word transformation probability is 
obtained. With respect to the word replacement probabilities, the converting part 7 controls the similarity degree calcu- 
lating part 1 1 to calculate it according to Exp. (25). That is. the similarity degree calculating part 1 1 obtains the number 
of words included in a concept in the thesaurus stored in the thesaurus memory 12 common to a word of the input 

to phrase I and a word constituting the foci® example phrase E and on the basis of that number of words obtains a word 
similarity degree expressing the similarity in meaning between the two words, i.e. the word replacement probability 
obtained by calculating Exp. (25). 

Next, Fig. 15 shows the construction of another preferred embodiment of a translating apparatus according to the 
invention. Parts in Fig. 15 corresponding to parts shown in Fig. 5 have been given the same reference numerals and 

is will not be described in the following. That is. except in that the converting part 7 has a cache 7A. this translating appa- 
ratus is basically constructed in the same way as that shown in Fig. 5. 

The cache 7A temporarily stores provisionally deleted words and provisionally added words. The cache 7A is called 
a 'cache' only because it stores information temporarily like a cache memory disposed between a CPU and main mem- 
ory, and it does not necessarily have to be a high-speed memory like an ordinary cache memory. 

20 In the preferred embodiment described above, as transforming operators operating on words constituting an exam- 
ple phrase E, the word copying operator echo-wordtew^iwn), the word deleting operator delete-word(ew m ), the word 
inserting operator add-word(iw n ) and the word replacing operator alter-word(ew m ,iw n ) were used, but with these four 
operators it is difficult to deal with cases where the example phrase E is transformed into the input phrase I just by the 
positions of the words of the example phrase E being changed (for example when the example phrase E is WATASHI 

25 WA Ml KAN O TABETAI' ('I want to eat an orange 1 ) and is to be transformed into the input phrase I 'Ml KAN O WATASHI 
WA TABETAI*) ('an orange - 1 want to eat') and cases where the example phrase E is to be transformed into the input 
phrase I by words of the example phrase E being be replaced with words of the input phrase I and also having their posi- 
tions changed (for example when the example phrase E is 'WATASHI WA MIKAN O TABETAI' ('I want to eat an orange') 
and is to be transformed into the input phrase I 'RINGO O WATASHI WA TABETAI' ('an apple - 1 want to eat*)). 

30 Also, in cases where there is included in the input phrase I a compound word (for example a compound noun) con- 
sisting of a word used as a modifier among the words of the input phrase I added to a word of the example phrase E 
(for example, when the example phrase E is 'DENWA O MITSUKERU* (find a telephone*) and the input phrase I is 
'KOUSHUUDENWA O MITSUKERU' (find a public telephone') and cases where there is included in the input phrase I 
a compound word consisting of a word used as a modifier among the words of the input phrase I added to a word of the 

35 example phrase E having been replaced with a word of the input phrase I (for example, when the example phrase E is 
'DENWA O MITSUKERU' (find a telephone') and the input phrase I is 'KOUSHUUTOIRE O MITSUKERU' (find a public 
toilet')) it is necessary to make a word of the example phrase E correspond with a compound word of the input phrase 
I (in the above examples. 'DENWA' and 'KOUSHUUDENWA' ('telephone* and 'public telephone'), 'DENWA' and 
'KOUSHUUTOIRE* (telephone' and public toilet')), but this is difficult to do with the four operators mentioned above. 

40 To overcome this, instead of the word deleting operator (an operator which irreversibly determines deletion at the 
time of its operation) delete-word(ew m ), which actually deletes the word ew m of the example phrase E, a provisionally 
deleting operator which is an operator for deleting the word ew m provisionally will be introduced. Because this provision- 
ally deleting operator temporarily removes (stores) the word being provisionally deleted (hereinafter referred to as the 
provisionally deleted word) ew m to the cache 7A. it will be written cache-as-deleted(ew m ). 

45 Also, instead of the word inserting operator add-word(iw n ), which actually inserts the word iw n of the input phrase 
into the example phrase E (irreversibly determines insertion at that time), a provisionally inserting operator which is an 
operator for inserting that word iw n into the example phrase E provisionally will be introduced. Because this provision- 
ally inserting operator temporarily removes the word iw n being provisionally inserted (hereinafter referred to as the pro- 
visionally inserted word) to the cache 7A, it will be written cache-as«added(iw n ). 

so Also, a scrambling operator scramble(ew m .iw n ). which is an operator for copying unchanged a word ew m of the 
example phrase E as a word iw n which among the words of the input phrase I is not the word aligned with the word ew m . 
or replacing the word ew m with such a word iw n , i.e. changes only the position of a word of the example phrase E or 
replaces a word of the example phrase E with a word of the input phrase I and also changes its position, will be intro- 
duced. 

55 Also, a compounding operator compoundfiWn.-j .iWp) which is an operator for identifying two consecutive words iw n . 
j and iw n of the input phrase I as constituting a compound word when those two words are a modifier and a modified 
word will be introduced. In this case, an operator for copying unchanged a word ew m of the example phrase E as a word 
iw n constituting the phrase input phrase I and making it form a compound word with the word iw n . t one word in front of 
it can be expressed as the combination of the word copying operator echo-word(ew m ,iw n ) and the compounding oper- 
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ator cornpound(iw rv1 ,iw n ) (hereinafter for convenience referred to as the copying and compounding operator). Also, an 
operator for replacing a word ew m of the example phrase E with a word iw n of the input phrase I and then making it form 
a compound word with the word iw^ one word in front of it can be expressed as the combination of the word replacing 
operator alter-word(ew m ,iw n ) and the compounding operator compound(iw n . 1 ,iw n ) (hereinafter for convenience referred 

5 to as the replacing and compounding operator). 

In the preferred embodiment shown in Fig. 15, as operators operating on the words of the example phrase E, the 
six operators that are the word copying operator echo-word (ew^iw^, the word replacing operator alter-word(ew m ,iw n ), 
the provisionally deleting operator cache-as-deleted(ew m ), the provisionally inserting operator cache-as-addedflwn), 
the scrambling operator scramWeteWn^.iWp) and the compounding operator compound(iw n _ 1 ,iw n ) are employed. Of 

10 these six operators, the compounding operator compound(iw rv1l iwn) only is not used alone and as described above is 
used as the copying and compounding operator or the replacing and compounding operator in combination with the 
word copying operator echo-word(ew m ,iw n ) or the word replacing operator alter-word(ew m ,iw n ). 

Of the newly introduced operators, the provisionally deleting operator cache-as-deleted(ew m ) and the provisionally 
inserting operator cache-as-addedflWn) can be used in the same ways as the word deleting operator delete-word(ew m ) 

is and the word inserting operator add-wordOw^ respectively (although in the point that they provisionally delete or insert 
words by storing the word in the cache 7A they differ from the word deleting operator delete-word(ew m ) and the word 
inserting operator add-word(iw n ), which irreversibly determine deletion or insertion of the word), but in the use of the 
scrambling operator scramble(ew m ,iw n ) and the copying and compounding operator and the replacing and compound- 
ing operator there are the following kinds of limitation. 

20 That is, transforming an example phrase E into an input phrase I by changing just the position of a word of the 
example phrase E or replacing a word of the example phrase E with a word of the input phrase I and then changing its 
position can be realized by either deleting the word whose position is to be changed and then inserting it in a predeter- 
mined position or by inserting the word whose position is to be changed in the predetermined position and then deleting 
the word in the original position. 

25 Therefore, when transforming an example phrase E into an input phrase I, to change the position of a word it is nec- 
essary for that word to have been deleted from the example phrase E or inserted into the input phrase I in the past. 
Because of this, the scrambling operator scramble(ew m .iw n ) is only used when a word ew m of the example phrase E 
has been provisionally deleted or when a word iw n of the input phrase i has been provisionally inserted, ie. when a pro- 
visionally deleted word ew m or a provisionally inserted word iw n has been stored in the cache 7A. 

30 Specifically, in calculating an optimum path, in a case where the transformation path from the mth word ew m of the 
example phrase E to the nth word iw n of the input phrase I is a problem, when a provisionally deleted word ew k (k<m) 
is stored in the cache 7A, it is possible to use the scrambling operator scramblefeWk.iWp) (the nth word iw n of the input 
phrase I can be deemed to have been made not by transforming the mth word ew m of the example phrase E but by a 
transformation changing the position of the kth word ew k of the example phrase E, without changing the word or after 

35 replacing the word). 

Also, in the case mentioned above, also when a provisionally inserted word iw s (s<n) is stored in the cache 7A, it 
is possible to use the scrambling operator scramble(ew m ,iw s ) (the mth word ew m of the example phrase E can be 
deemed not to have been transformed into the nth word iw n of the input phrase I but to have been transformed into the 
sth word iw s of the input phrase I, either without being changed or after being replaced, by having its position changed). 
40 When the scrambling operator Scramblefewk.iWn) or the scrambling operator scramble(ew m ,iw s ) has been used 
(when in the process of calculating the optimum path a transformation path corresponding to one of these has been 
selected), because at that time it is finally determined that the provisionally deleted word ew k or the provisionally 
inserted word iw s has not been deleted or inserted, that is, it is finally determined that its position has been changed, it 
is erased from the cache 7A. 

45 Next, concerning the copying and compounding operator and the replacing and compounding operator, there are 

the following kinds of limitation on their use. 

That is, to copy without changing it a word ew m of the example phrase E as a word iw n of the input phrase I and 

make it form a compound word with the word iw^-i one word in front of it, or to replace a word ew m of the example 

phrase E with a word iw n of the input phrase I and make it form a compound word with the word iw^ one word in front 
so of it, it is necessary for the word iw n .., serving as a modifier to have in the past been inserted into the input phrase L 

Consequently, the copying and compounding operator and the replacing and compounding operator are used only 

when a word of the input phrase I has been provisionally inserted in the past, i.e. when the provisionally inserted 

word iw n .«j is stored in the cache 7A. 

Specifically, in calculating the optimum path, when the transformation path from the mth word ew m of the example 
55 phrase E to the nth word iw n of the input phrase I is a problem, the copying and compounding operator and the replacing 

and compounding operator can be used when the provisionally inserted word ^w^ has been stored in the cache 7A, 

i.e. when the word iw n _., has been provisionally inserted in front of the word iw n . 

When the copying and compounding operator or the replacing and compounding operator has been used, because 

at that point in time it is finally determined that the provisionally inserted word iw n .., has not been inserted, i.e. it is finally 
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determined that it constitutes a compound word, it is erased from the cache 7A. 

Next, to obtain the word transformation probabilities of when transformation of words is carried out using these six 
transforming operators (the word copying operator echo-word(ew m ,iw n ), the word replacing operator alter- 
wordfew^iwn), the provisionally deleting operator cache-as-de!eted(ew m ), the provisionally inserting operator cache- 
's as-added(iWn). the scrambling operator scramble(ew m , iw n ) and the compounding operator compound0wn.-i.iwn)). prob- 
abilities of the transforming operators (probabilities of transformations using the transforming operators being carried 
out) are necessary, and these can be defined for example as follows. 

That is, first, the probability (the word copying probability) P(echo-word(ew m ,iw n )) for the word copying operator 
echo-word(ew m .iw n ) and the probability (the word replacement probability) P(atter-word(ew m ,iWn)) for the word replac- 
10 ing operator atter-word(ew m .iWn) are given by Exp. (22) and Exp. (25) respectively, as in the preferred embodiment 
described above. 

Next, the probability (hereinafter for convenience referred to as the provisional deletion probability) P(cache-as- 
deleted(ew m )) for the provisionally deleting operator cache-as-deleted(ew m ) is given for example using the word dele- 
tion probability P(delete-word(ew m )) and the word copy probability P(echo-word(ew m ,iw n )) so as to satisfy the following 
15 expression. 

P(delete-woixl(ew m ))<P(cache-as<leleted(ew m ))<P(echo-word(ew m .iw n )) (32) 

Here, the provisional deletion probability P(cache-as-deleted(ew m )) has a value satisfying Exp. (32) and for exam- 
20 pie lower than the word replacement probability P(alter-word(ew m ,iw n )) for a similar word and higher than the word 
replacement probability P(arter-word(ew m .iw n )) for a dissimilar word. 

The probability for the provisionally inserting operator cache-as-added(iw n ) (hereinafter for convenience referred to 
as the provisional insertion probability) P(cache-as-added(iwn)) is given for example using the word insertion probability 
P(add-word(iw n )) and the word copy probability P(echo-word(ew m .iw n )) so as to satisfy the following expression. 

25 

P(add-word(iw n ))<P(cache-as-added(iw n ))<P(echo-word(ew m .iw n )) (33) 

Here, the provisional insertion probability P(cache-as-added(iw n )) has a value satisfying Exp. (33) and for example 
lower than the word replacement probability P(alter-word(ew m .iw n )) for a similar word and higher than the word replace- 
30 ment probability P(alter-word(ew m ,iWn)) for a dissimilar word. 

Also, when the word ew m is the same as the word iw n . the word copy probability P(echo-word(ew m ,iw n )) in Exps. 
(32) and (33) is given by Exp. (22) (when the words ew m and iw n are not the same, because as mentioned above the 
word copy probability P(echo-word(ew m .iw n )) becomes 0, in this case, the upper limit of the provisional deletion proba- 
bility P(cache-as-deleted(ew m )) and the provisional insertion probability P(cache-as-added(iw n )) is not limited by the 
35 word copy probability P(echo-word(ew m .iWn))). 

The probability P(scramble(ew m ,iWn)) (hereinafter for convenience referred to as the scramble probability) for the 
scrambling operator scramble(ew mt iw n ) can be given by the following expressions. 

P(scramble(ew m .iw n )) = f(P(alter-word(ew m .iw n )),iw n ) when ew m + iw n (35) 

40 

P(scramble(ew m .iw J) = f(P(echo-word(ew m .iw n )).iw n ) when ew m = iw n 

In Exp. (35). the function fO obtains the likelihood of occurrence of a phenomenon (scrambling) of the order of 
words or phrases and so on changing, and can be set taking into account for example the nature of the word stored in 

45 the cache 7A (for example its part of speech), the language of the input phrase I and the situation in which the input 
phrase I is being used. That is. the function f() can be set so as to give a higher probability with respect to input phrases 
I of Japanese, in which word order changes are freer than in English and the like, than to input phrases I of English. The 
function fO can also be set so as to give a higher probability with respect to spoken language, in which word order 
changes such as inversions are more likely to occur than in written language. 

so In Exp. (35), as the argument of the function f(), when ew m *iw n the word replacement probability P(alter- 
wordfew^iwn)) is used; this is because when the words ew m and iw n are not the same (when ew m *iw n ). it can be con- 
sidered that the word of the example phrase E has been replaced and the word order has been changed, and when the 
words ew m and iw n are the same (when ew m =iw n ) it can be considered that the word of the example phrase E has 
been copied without being changed and only the word order has been changed. 

55 In Exp. (35). in both the cases of ew m *iw n and ew m =iw n . as the argument of the function f(). the word iw n of the 
input phrase I is used; this is because it can be supposed that the likelihood of a word order change varies depending 
on the word iw n . That is. for example in Japanese there are almost no cases where a verb is moved to the beginning, 
and therefore when the word iw n is a verb it takes a value such that the scramble probability P(scramble(ew m ,iw n )) is 
small. 
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Next, the probability (hereinafter for convenience referred to as the compound probability) P(compound(iw n _ 1 ,iw n )) 
is for example given by the following expression. 

P(compound(iw rv1 ,iw n ))=g(iw ^ ,iw n ) (36) 

5 

In Exp. (36), the function g(iw n . 1t iw n ) expresses the probability of the consecutive words iw n .., and iw n forming a 
compound word, and this can be calculated for example in the following way That is, it is possible for example to 
prestore numerous examples of compound words and find the compound word most similar to the combination of the 
words iw^, iw n and normalize its degree of similarity to obtain a probability of them forming a compound word. 

io When the degree of similarity between the combination and the stored compound word example is large enough, 
the compound probability P(compound(rw n . 1t iw n )) is higher than the word insertion probability P(add-word(iw n )). 

The probability (hereinafter for convenience referred to as the copy and compound probability) of a word ew m of the 
example phrase E being copied as a word iw n of the input phrase I without being changed and forming a compound 
word together with the word in front of it is the product of the word copy probability P(echo-word(ew m ,iw n )) and the com- 

is pound probability P(compound(iw rv1 ,iw n )), and the probability (hereinafter for convenience referred to as the replace 
and compound probability) of a word ew m of the example phrase E being replaced with a word iw n of the input phrase 
I and forming a compound word together with the word in front of it is the product of the word replacement probability 
P(alter-word(ew m ,iw n )) and the compound probability PfcompoundOWn.-! ,iWn)). 

With the six transforming operators of the word copying operator echo-word(ew mi iWn). the word replacing operator 

20 alter-word(ew m ,iw n ), the provisionally deleting operator cache-as-deleted (ew^J, the provisionally inserting operator 
cache-as-added(iw n ), the scrambling operator scrambletew^iwn) and the compounding operator compound(iw n _ 1 ,iwn) 
it is possible to carry out the following eight kinds of transformation. 

That is, firstly, with the word copying operator echo-word(ew m ,iw n ), it is possible to make the word ew m of the exam- 
ple phrase E the word iw n of the input phrase I without changing it. Secondly, with the word replacing operator alter- 

25 wordCew^iWn), it is possible to replace the word ew m of the example phrase E with the word iw n of the input phrase I. 
Thirdly, with the provisionally deleting operator cache-as-deleted(ew m ), it is possible to provisionally delete the word 
ew m of the example phrase E, and fourthly, with the provisionally inserting operator cache-as-added(iw n ). it is possible 
to provisionally insert the word iw n of the input phrase I. 

Also, with the scrambling operator scramble(ew m ,iw n ), it is possible to carry out the following two word order 

30 changes. That is, fifthly, with the scrambling operator Scramble(ew k ,iw n ) t it is possible to change the word order by 
inserting a provisionally deleted word ew k stored in the cache 7A as the nth word iw n of the input phrase l f and sixthly, 
with the scrambling operator scramble(ew m ,iw s ), it is possible to make a provisionally inserted word iw s a change in the 
word order of the mth word ew m of the example phrase E. 

Seventhly, with the combination (copying and compounding operator) of the word copying operator echo- 

35 word(ew m ,iWn) and the compounding operator compoundCrWn^ ,iw n ), it is possible without changing it to copy the word 
ew m of the example phrase E as the word ew m of the input phrase I and make it form a compound word with the word 
iw^-i one word in front of it, and eighthly, with the combination (replacing and compounding operator) of the word replac- 
ing operator alter-word(ew m ,iw n ) and the compounding operator compound(iw n _.,,iw n ), it is possible to replace the word 
ew m of the example phrase E with the word iw n of the input phrase I and make it form a compound word with the word 

40 iwn.! one word in front of it. 

Considering finding the optimum set of transforming operators able to carry out these eight transformations, i.e. the 
optimum path, by means of DP matching, this can be done for example by a calculating cumulative distance G(m,n) 
using weightings of paths corresponding to the eight transformations shown in Exp. (37), similar to the case in Exp. (31). 

45 
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G(m, n)=min< 



G(m-1 , n— 1) - log P (echo— wo rd (e w m ,iw n ) ) 
G(m-1 , n-1) - logP(aUer-word(ew fn ,iw n )) 
G{m-l' ( n)- !ogP(cache-as-deleted(ew m )) 
G(m n -l)- !ogP(cache-as-added(iw n )) 
Q( mr n -1)- logP(scramble(ew ki iw n )) 
G(m-1, n)- logP(scramble(ew mi iw s )) 
G(m-1, n-1) - logP(Qcho-word(ew m .iWn)) 

- logP(compound(iw n -i*,iw n )) 
L G(m-1, n-1) - logP(aker-word(ew mt iw n )) 

- logP(compound(iw n - lf fw n )) 



(37) 



In the preferred embodiment shown in Fig. 15, in the converting part 7, by calculating Exp. (37) until m=M , using 
the cache 7A as necessary, an optimum path is found and a word transformation probability is calculated. 

That is, as shown in the flow chart of Fig. 16, in the converting part 7. first, in a step S61 , according to Exp. (37), 
the cumulative distance G(m,n) of when the word ew m constituting a focus example phrase E is made to correspond 
with the word iw n of the input phrase I is found. 

Then, proceeding to a step S62, it is determined whether or not in the calculation of the cumulative distance G(m,n) 
in the step S61 the path corresponding to the provisionally deleting operator cache-as-deleted(ew m ). i.e. the third 
expression from the top on the right hand side in Exp. (37) was selected, and when it is determined that it was selected 
processing proceeds to a step S63. In the step S63. the word ew m provisionally deleted by the provisionally deleting 
operator cache-as-deleted(ew m ) is removed to (stored in) the cache 7 A and processing proceeds to a step S64. 

When in the step S62 it is determined that the path corresponding to the provisionally deleting operator cache-as- 
deleted(ew m ) was not selected, the step S63 is skipped and processing proceeds to the step S64, wherein it is deter- 
mined whether or not in the calculation of the cumulative distance G(m,n) the path corresponding to the provisionally 
inserting operator cache-as-added(iw n ), i.e. the fourth expression from the top on the right hand side in Exp. (37), was 
selected. When in the step S64 it is determined that the path corresponding to the provisionally inserting operator 
cache-as-added(iw n ) was selected, processing proceeds to a step S65 and the word ew m provisionally inserted by the 
provisionally inserting operator cache-as-addedOwn) is removed to the cache 7A, and processing proceeds to a step 
S66 

When in the step S64 it is determined that the path corresponding to the provisionally inserting operator cache-as- 
added(iWn) was not selected, processing skips the step S65 and proceeds to a step S66, wherein it is determined 
whether or not in the calculation of the cumulative distance G(m,n) a path corresponding to the copying and compound- 
ing operator or the replacing and compounding operator, i.e. the expression on the seventh line or the eighth line from 
the top on the right side in Exp. (37). was selected. When in the step S66 it is determined that a path corresponding to 
the copying and compounding operator or the replacing and compounding operator was selected, processing proceeds 
to a step S67, and because a provisionally deleted word iw n .«, made a modifier constituting a compound word by the 
copying and compounding operator or the replacing and compounding operator is stored in the cache 7Athis is erased 
and processing proceeds to the step S68. 

When in the step S66 it is determined that neither of the paths corresponding to the copying and compounding 
operator or the replacing and compounding operator was selected, processing skips the step S67 and proceeds to the 
step S68 and it is determined whether or not in the calculation of the cumulative distance G(m.n) a path corresponding 
to the scrambling operator scramble(ew k ,iw n ) or the scrambling operator scramble(ew m ,iw s ), i.e. the expression on the 
fifth or the sixth line from the top on the right side in Exp. (37) was selected. When in the step S68 it is determined that 
a path corresponding to the scrambling operator scramble(ew k ,iw n ) or the scrambling operator scramble(ew m ,iw s ) was 
selected, processing proceeds to a step S69 wherein because a provisionally deleted word ew k or a provisionally 
inserted word iw 3 is stored in the cache 7A this is erased, and then proceeds to a step S70. 

When on the other hand in the step S68 it is determined that neither of the paths corresponding to the scrambling 
operators scramble(ew k .iw n ) or scramble(ew m .iw s ) were selected, processing skips the step S69 and proceeds to the 
step S70. wherein it is determined whether or not m is less than M (the number of words constituting the focus example 
phrase E). When it is determined that m is less than M, processing returns to the step S61 and the converting part 7 
increases rn and n and repeats the subsequent processing. When in the step S70 it is determined that m is less than 
M, i.e. m is equal to M, processing proceeds to a step S71 and it is determined whether or not a provisionally deleted 
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word ew m or a provisionally inserted word iw n is stored in the cache 7A. 

When in the step S71 it is determined that a provisionally deleted word ew m or a provisionally inserted word iw n is 
stored in the cache 7A, processing proceeds to a step S72 and, among the paths of when the cumulative distance 
G(M,n) was obtained, the path corresponding to the provisionally deleting operator cache-as-deleted(ew m ) having pro- 

5 visionaliy deleted the provisionally deleted word ew m stored in the cache 7A or the path corresponding to the provision- 
ally inserting operator cache-as-added(iw n ) having provisionally inserted the provisionally inserted word iw n stored in 
the cache 7A is respectively converted into the path corresponding to a word deleting operator delete-word(ew m ) or a 
path corresponding to the word inserting operator add-word(*rw n ) and the path obtained as a result is taken as the opti- 
mum path, and processing proceeds to a step S73. 

10 When in the step S71 it is determined that neither a provisionally deleted word ew m nor a provisionally inserted 
word iw n is stored in the cache 7A, the path of when the cumulative distance G(M,n) was obtained is taken unchanged 
as the optimum path, processing proceeds to the step S73 and the word transformation probability is calculated follow- 
ing this optimum path. 

In this case, the optimum path includes a path corresponding to the provisionally deleting operator cache-as- 
15 deleted(ew m ) or the provisionally inserting operator cache-as-added(iw n ) respectively having provisionally deleted or 
provisionally inserted the provisionally deleted word ew m or the provisionally inserted word iw n erased from the cache 
7A, but this path can be ignored in calculating the word transformation probability. 

As a result of the scrambling operator scramblefewm.iwp) being introduced together with the provisionally deleting 
operator cache-as-deleted(ew m ) and the provisionally inserting operator cache-as-added (wj. as described above, 
20 even when there is a difference in word order between an input phrase I and an example phrase E which are similar, it 
becomes possible to determine their similarity correctly. 

Also, as a result of the compounding operator compound(iw n . 1 ,iw n ) being introduced, it becomes possible to handle 
compound words as well. 

A calculating method using memory means like the cache 7A for temporarily storing provisionally deleted words 
25 and provisionally inserted words is applied to language models for voice recognition in for example "A Cache-based 
Natural Language Model for Speech Recognition". Roland Kuhn and Renato De Mori. IEEE Transactions on Pattern 
Analysis and Machine Intelligence, vol.12, No.6. June 1990. 

Here, a language model based on the hypothesis that the probability of a recently-used word appearing (being spo- 
ken) again is higher than the probability of that word first appearing is proposed, wherein recently-used words are 
30 stored in memory means and the probability of an ith word Wj being a predetermined word W is calculated with refer- 
ence to this memory means. 

That is, for example in an ordinary 3g-gram model, when the parts of speech of the i-1th and i-2th words are 
respectively written g M and g^. the probability P(W j= W|g ^.g M ) of the ith word Wj being a predetermined word W is 
calculated for example using the following expression. 

35 

P(W j =W|g, 2 ,g M )= £ PtWpWIg^g^PCg^g^g^.g,,) (38) 

40 

Here, G is a set of parts of speech in the language that is the object of the voice recognition. 

In the aforementioned literature, a method of calculating the P(Wj=W|g ,og p on the right side of Exp. (38) accord- 
ing to the following Exp. (39) by storing recently-used words in storing means is proposed. 

45 p (W i =W|g j =g j )=k MJ xf(W j =W|g j =g j ) + k cj xC j (W,») (39) 

Here, k M j+k c j = 1 and j and kc j are both variables indexed only by j. 

The Cj(W,i) on the right side of Exp. (39) is a probability calculated by referring to the memory means, and changes 
depending on whether the word W has appeared recently. 

so Therefore, the means in the preferred embodiment shown in Fig. 15 has something in common with the means of 
the aforementioned literature, wherein words are stored in memory means and probabilities are calculated with refer- 
ence to that, in the point that words are stored in the cache 7A and probabilities are calculated with reference to this; 
however, it differs from the means of the aforementioned literature, wherein words having appeared recently are stored 
in the storing means, in that only provisionally deleted words and provisionally inserted words are stored in the cache 

55 7A. 

Wrth the compounding operator compound(*rw rv1 .iw n ), as well as it being possible to handle compound nouns of the 
kind mentioned above, it is possible for example to handle such times as when the example phrase E is 'INU WA 
KAWAII' ('dogs are cute 1 ) and the input phrase I is WATASHI NO INU WA KAWAII' ('my dog is cute') and a compound 
word 'WATASHI NO INU* ('my dog') made up of the modifier WATASHI NO' ('my') added to the word 'INU* ('dog') of the 



27 



EXSDOC13- <EP C305403A2J_> 



EP 0 805 403 A2 



input phrase I corresponds to the word 'INU' of the example phrase E. However, in cases such as 'WATASHI NO INU 
("my doq") wherein it is dear that -WATASHI NO' {'my-) modifies 'INU' ('dog'), by applying the replacing operator alter- 
wordf'INU' -WATASHI NO INU 1 ) to the 'INU' of the example phrase E and the "WATASHI NO INU' of the input phrase I 
and using a noun phrase example -WATASHI NO X' ('my X) (where X represents a noun), it is possible to process the 
phrase correctly and more efficiently than when the compounding operator compound(iw n . 1 .iw n ) is used. 

That is. the compounding operator compound(iw n . 1 ,iw n ) is effective in cases such as when a compound word of 
which the modifying relationship is unclear, for example one not containing the (possessive) particle 'NO' (for example 
a compound noun) is inputted into the inputting part 1. or when in a voice recognition device in the inputting part la 
particle is not recognized and for example "WATASHI. INU WA KAWAII' is outputted from the inputting part 1 with 
respect to an actual input of WATASHI NO INU WA KAWAII'. 

In the above, a case wherein the invention is applied to a translating apparatus for carrying out translation from Jap- 
anese into English was described, but the invention can also be applied to translating apparatuses tor performing trans- 
lation between other languages. 

It is possible to provide the translating apparatus with buttons for correcting and confirming translation results out- 
putted from the outputting part 1 6 (hereinafter for convenience referred to respectively as the correction button and the 
conf irmation button). The translating apparatus can be made to carry out subsequent processing when the confirmation 
button is operated confirming that the translation result is correct. Also, the translating apparatus can be made to carry 
out translation processing again when the correction button is operated indicating that the translation result is wrong. 
That is tor example, the translating apparatus can be made to detect the next highest translation suitability and carry 
out translation on the basis of that example. Furthermore, it is also possible to provide the translating apparatus with a 
control part for correcting translation results outputted from the outputting part 16. In this case, when translation results 
have been corrected by the control part being operated, it is possible to store examples corresponding to the results of 
this conection in the noun phrase translation example memory 8, the verb phrase translation example memory 9 or the 
other translation example memory 10. , , . ,_ . 

Although in the preferred embodiments described above a priori probability P(Ei) was found for each example E ( for 
example accoiding to Exp. (5) or as described above with reference to 1 1 . for this priori probability P(Ej) it is also pos- 
sible to use the same value, for example the inverse 1/N E of the number of examples N E . for all the examples Ej. 

In these preferred embodiments, in the similarity degree calculating part 1 1 . the word replacement probability was 
found on the basis of the number of words included in a concept common to the two words concerned, but it is also pos- 
sible for the word replacement probability to be found on the basis of the level of the class to which the concept common 
to the two words belongs in the thesaurus, as in the related art. That is. when the number of classes of the thesaurus 
is written C and the level of the class to which the concept common to a word iw n of an input phrase I and a word ew m 
of an example phrase E belongs is written L. it is possible to find the word replacement probability P(atter- 
worcKewjn.iWn)) according to the following expression. 

P(alter-word(ew m .iw „)) «-^r ^ 40) 
2 



Also although in the preferred embodiments the word deletion probability and so on were determined on the basis 
of the part of speech of the word (whether the word is an independent word or a functional word, and so on), depending 
on the domain in which the translating apparatus is to be used there are cases in which it is effective to determine them 
on the basis of information other than the part of speech. That is. it is possible to determine the word deletion probability 
and so on taking into consideration factors such as that in spoken language pronouns of the first and second person 
and so on tend to be omitted and that words conveying a topic in context tend to be omitted because the topic is dear 
to the people talking. 

Also, it is possible to give the word insertion probability and the word deletion probability a predetermined constant 
value to apply in all cases, as shown in Exps. (41) and (42) respectively. 

P(add-word(iw n ))-add-word ( 41 ) 

P(delete-word(ew m ))=delete-word ( 42 ) 

The word deletion probability and so on can also be given according to a predetermined calculation formula. 

Although in the preferred embodiments translation was carried out in clause or phrase units, it is also possible for 
translation to be carried out in other syntax units. It is also possible for translation to be carried out without the first lan- 
guage sentence being divided into such syntax units. Furthermore, although in the preferred embodiments descnbed 
above the example phrases were stored classified into noun phrases, verb phrases and other phrases, the method of 
classification is not limited to this. 
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As described above, in a translating apparatus and a translating method according to the invention, a first language 
sentence is divided into syntax units consisting of predetermined units of sentence structure and examples similar to 
these syntax units of the first language sentence are detected. Then, on the basis of these detected examples, the first 
language sentence is translated in syntax units and the results of translation of the syntax unite are compounded to 
5 generate a second language sentence. Therefore, efficient translation processing becomes possible and as a result the 
translation processing speed can be increased. 

In another translating method according to the invention, the first language sentence is divided into syntax unite 
consisting of predetermined units of sentence structure, in stages from large syntax units into small syntax unite, and 
the syntax unite obtained at each stage are collated with examples, and examples corresponding to the syntax units are 

10 detected on the basis of the results of this collation. The first language sentence is then translated in syntax units on 
the basis of translations corresponding to these detected examples, and the results of translation of the syntax unite are 
compounded to generate a second language sentence. Therefore, efficient translation processing becomes possible 
and as a result the translation processing speed can be increased. 

In another translating apparatus and translating method according to the invention, a degree of similarity express- 

15 ing the similarity between a word of a first language sentence and a word of an example is calculated on the basis of 
the number of words included in a concept common to the word of the first language sentence and the word of the 
example in a thesaurus wherein words are classified in a tree structure on the basis of their concepts. Therefore, it 
becomes possible to calculate an accurate degree of similarity irrespective of the structure of the thesaurus and as a 
result the translation processing speed can be increased. 

20 In another translating apparatus and another translating method according to the invention, an example similar to 
a first language sentence is detected on the basis of a priori probability of the example being used to translate the first 
language sentence and a transformation probability of the example being transformed into the f irst language sentence 
and used, and the first language sentence is translated on the basis of a translation corresponding to the detected 
example. Therefore, it is possible to perform translation processing which is suitable in terms of probability. 

25 In another translating apparatus and translating method according to the invention, by syntax analysis being per- 
formed on a first language sentence, grammatical attributes of the sentence are extracted and an example similar to the 
first language sentence is detected taking into account grammatical attributes of the first language sentence and of the 
example. The first language sentence is then translated on the basis of a translation corresponding to the detected 
example. Therefore, it becomes unnecessary to store multiple superficially different examples having the same mean- 

30 ing content. 

Various other modifications and application examples are of the invention are conceivable within the scope of the 
invention. Therefore, the invention is not limited to the preferred embodiments described above. 

Claims 

35 

1. A translating apparatus for translating a first language sentence expressed in a first language into a secondlan- 
guage sentence expressed in a second language, comprising: 

example memory means (3) storing examples expressed in said first language and corresponding translations 
to of said examples in said second language; 

dividing means (4) for dividing said first language sentence into syntax units consisting of predetermined units 
of sentence structure; 

detecting means (6) for detecting for each of said syntax units of said first language sentence outputted by said 
dividing means an example similar to that syntax unit from among said examples; 
45 translating means (7) for translating said first language sentence in said syntax units on the basis of those of 

said translations corresponding to those of said examples detected by said detecting means (6); and 
generating means (1 5) for generating said second language sentence by compounding results of translation of 
said syntax unite obtained by said translating means. 

so 2. A translating apparatus according to claim 1 , wherein said example memory means (3) stores said examples and 
said corresponding translations in said syntax units. 

3. A translating apparatus according to claim 1 or 2, wherein said dividing means (4) divides said first language sen- 
tence in stages from large syntax units to small syntaxunits. 

55 

4. A translating apparatus according to claim 3. wherein said dividing means (4) comprises clause dividing means for 
dividing said first language sentence into clause units and phrase dividing means for dividing said clause units of 
said first language sentence outputted from said clause dividing means into phrase units. 
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5. A translating apparatus according to claim 4, wherein said example memory means (3) comprises clause unit 
example memory means (5) storing examples in clause units and 
phrase unit example memory means storing phrase examples in phrase units. 

s 6. A translating apparatus according to claim 5. wherein said phrase unit example memory means (3) stores said 
examples classified at least into noun phrases and verb phrases. 

7. A translating apparatus according to claim 3, wherein said dividing means (4) divides said first language sentence 
into large syntax units and when none of said examples matches any of said large syntax units divides said large 

10 syntax units into smaller syntax units. 

8. A translating apparatus according to claim 1 , wherein said example memory means (3) stores said examples 
together with grammatical attributes thereof. 

15 9. A translating apparatus according to claim 8, wherein said dividing means (4) divides said first language sentence 
into said syntax units and extracts grammatical attributes of said syntax units by carrying out syntax analysis and 
said detecting means (6) detects those of said examples similar to said clause units taking into account grammat- 
ical attributes of said syntax units and said examples. 

20 1 0. A translating apparatus according to anyone of the preceding claims, wherein said detecting means (6) detects said 
example similar to said syntax unit on the basis of a priori probability of said example being used to translate said 
syntax unit and a transformation probability of said example being transformed into said syntax unit and used. 

11. A translating apparatus according to claim 10. wherein said transformation probability is calculated from a gram- 
25 matical attribute transformation probability of grammatical attributes of said example being transformed and a word 

transformation probability of words of said example being transformed. 

12. A translating apparatus according to claim 1 1 , wherein said grammatical attribute transformation probability is cal- 
culated from a grammatical attribute copy probability of a grammatical attribute of said example being used 

30 unchanged, a grammatical attribute deletion probability of a grammatical attribute of said example being deleted, a 
grammatical attribute addition probability of a grammatical attribute of said syntax unit being added, and a gram- 
matical attribute replacement probability of a grammatical attribute of said example being replaced with a grammat- 
ical attribute of said syntax unit. 

35 13. A translating apparatus according to claim 11. wherein said word transformation probability is calculated from a 
word copy probability of a word of said example being used unchanged, a word deletion probability of a word of 
said example being deleted, a word addition probability of a word of said syntax unit being added, and a word 
replacement probability of a word of said example being replaced with a word of said syntax unit. 

40 14. A translating apparatus according to claim 13. further comprising: 

thesaurus memory means (12) storing a thesaurus wherein words are classified in a tree structure on the basis 
of their concepts; and 

word similarity degree calculating means (1 1) for calculating a word similarity degree expressing a similarity 
45 between a word of said syntax unit and a word of said example on the basis of said thesaurus (12) and output- 

ting said word similarity degree as said word replacement probability. 

15, A translating apparatus according to claim 14. wherein said word similarity degree calculating means (1 1) calcu- 
lates said word similarity degree on the basis of the number of words included in a concept common to said word 

so of said syntax unit and said word of said example in said thesaurus. 

16. A translating apparatus according to claim 1 1 . wherein said word transformation probability is calculated according 
to an optimum transformation path for transforming said example into said syntax unit. 

55 1 7. A translating apparatus according to claim 1 6. wherein said optimum transformation path is found by dynamic pro- 
gramming. 

18. A translating apparatus according to claim 13. wherein said word transformation probability is calculatedfurther 
using at least one among a word scramble probability of a word of said example unchanged or replaced with a word 
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of said syntax unit being used with its position changed, a word copy and compound probability of a word of said 
example having a modifier added thereto and being used as a compound word, and a word replace and compound 
probability of a word of said example replaced with a word of said syntax unit having a modifier added thereto and 
being used as a compound word. 

5 

1 9. A translating apparatus according to claim 1 8. wherein said word transformation probability is calculated according 
to an optimum transformation path for transforming said example into said syntax unit. 

20. A translating apparatus according to claim 19. wherein in finding said optimum transformation path instead of an 
w actual deletion path corresponding to actually deleting a word of said example a provisional deletion path provision- 
ally deleting a word of said example is used and instead of an actual addition path corresponding to actually adding 
a word of said syntax unit a provisional addition path provisionally adding a word of said syntax unit is used, 

further comprising word memory means for storing a provisionally deleted word and a provisionally added 
word provisionally deleted or added according to said provisional deletion path or said provisional addition path. 

15 

21 . A translating apparatus according to claim 20, wherein a scramble path corresponding to using a word of said 
example unchanged or replaced with a word of said syntax unit with its position changed is selected only when 
either a word of said example has been stored in said word memory means as said provisionally deleted word or a 
word of said syntax unit has been stored in said word memory means as said provisionally added word, and there- 
to after said word of said example stored as said provisionally deleted word or said word of said syntax unit stored as 

said provisionally added word is erased from said word memory means, and 

a copy and compound path corresponding to a word of said example having a modifier added thereto and 
being used as a compound word and a replace and compound path corresponding to a word of said example 
replaced with a word of said syntax unit having a modifier added to it and being used as a compound word are 
25 selected only when a word to become said modifier has been stored in said word memory means as said provision- 
ally added word, and thereafter said word to become a modifier stored as said provisionally added word is erased 
from said word memory means. 

22. A translating apparatus according to claim 21. wherein after the end point of a transformation path transforming 
30 said example into said syntax unit is reached a provisional deletion path or a provisional adding path provisionally 

deleting or adding said provisionally deleted word or said provisionally added word stored in said word memory 
means is converted into an actual deleting path or an actual adding path respectively and the path obtained is 
made said optimum transformation path. 

35 23. A translating apparatus according to claim 1 0, wherein said priori probability or said transformation probability is 
calculated on the basis of corpus data. 

24. A translating apparatus according to claim 10, wherein said priori probability or said transformation probability is 
calculated on the basis of said examples stored in said example memory means (3). 

40 

25. A translating method for translating a first language sentence expressed in a first language into a second language 
sentence expressed in a second language using example memory means (3) storing examples expressed in said 
first language and corresponding translations of said examples in said second language, comprising the steps of: 

45 dividing (4) said first language sentence into syntax units consisting of predetermined units of sentence struc- 

ture; 

detecting (6) for each of said syntax units of said first language sentence an example similar to that syntax unit 
from among said examples; 

translating (7) said first language sentence in said syntax units on the basis of those of said translations corre- 
50 sponding to the detected examples; and 

generating (15) said second language sentence by compounding results of translation of said syntax units. 

26. A translating method for translating a first language sentence expressed in a first language into a second language 
sentence expressed in a second language using example memory means (3.5) storing examples expressed in said 

55 first language and corresponding translations of said examples in said second language, comprising the steps of: 

dividing (4) said first language sentence into syntax units consisting of predetermined units of sentence struc- 
ture in stages from large syntax units into small syntax units and collating syntax units obtained at each stage 
with said examples; 



31 



.CSU5403A2J_> 



EP 0 805 403 A2 

detecting (6) for each of said syntax units an example corresponding to that syntax unit from among said exam- 
ples on the basis of results of the collation; 

translating (7) said first language sentence in said syntax units on the basis of those of said translations corre- 
sponding to the detected examples; and 

generating (15) said second language sentence by compounding results of translation of said syntax units. 

27. A translating apparatus for translating a first language sentence expressed in a first language into a second lan- 
guage sentence expressed in a second language, comprising: 

example memory means (3.5) storing examples expressed in said first language and corresponding transla- 
tions of said examples in said second language; 

thesaurus memory means (1 2) storing a thesaurus wherein words are classified in a tree structure on the basis 
of their concepts; and 

calculating means (11) for calculating word similarity degrees each expressing the similarity between a word 
of said first language sentence and a word of one of said examples on the basis of said thesaurus (12); 
detecting means (6) for detecting from among said examples an example similar to said first language sen- 
tence on the basis of said word similarity degrees calculated by said calculating means; and 
translating means (7) for translating said first language sentence on the basis of a translation among said 
translations corresponding to said example detected by said detecting means. 

wherein said calculating means (1 1) calculates each of said word similarity degrees on the basis of the 
number of words included in a concept common to a word of 

said first language sentence and a word of one of said examples in said thesaurus. 

2a A translating method for translating a f irst language sentence expressed in a f irst language into a second language 
sentence expressed in a second language using example memory means (3.5) storing examples expressed in said 
first language and corresponding translations of said examples in said second language, comprising the steps of: 

calculating (11) word similarity degrees each expressing the similarity between a word of said first language 
sentence and a word of one of said examples on the basis of a thesaurus (12) wherein words are classified in 
a tree structure on the basis of their concepts; 

detecting (6) from among said examples an example similar to said first language sentence on the basis of said 
word similarity degrees; and 

translating (7) said first language sentence on the basis of a translation among said translations corresponding 
to said example detected; 

wherein each of said word similarity degrees is calculated on the basis of the number of words included 
in a concept common to a word of said first language sentence and a word of one of said examples in said the- 
saurus (12). 

29. A translating apparatus for translating a first language sentence expressed in a first language into a second lan- 
guage sentence expressed in a second language, comprising: 

example memory means (3.5) storing examples expressed in said first language and corresponding transla- 
tions of said examples in said second language; 

detecting means (6) for detecting from among said examples an example similar to said first language sen- 
tence on the basis of a priori probability of said example being used for translating said first language sentence 
and a transformation probability of said example being transformed into said first language sentence and used; 

and . 

translating means (7) for translating said first language sentence on the basis of a translation among said 

translations corresponding to said example detected by sad detecting means (6). 

30 A translating apparatus according to claim 29. wherein said transformation probability is calculated from a gram- 
matical attribute transformation probability of grammatical attributes of said example being transformed and a word 
transformation probability of words of said example being transformed. 

81. A translating apparatus according to claim 30. wherein said grammatical attribute transformation probability is cal- 
culated from a grammatical attribute copy probability of a grammatical attribute of said example being used 
unchanged, a grammatical attribute deletion probability of a grammatical attribute of said example being deleted, a 
grammatical attribute addition probability of a grammatical attribute of said first language sentence being added. 
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and a grammatical attribute replacement probability of a grammatical attribute of said example being replaced with 
a grammatical attribute of said first language sentence. 

32. A translating apparatus according to claim 30, wherein said word transformation probability is calculated from a 
5 word copy probability of a word of said example being used unchanged, a word deletion probability of a word of 

said example being deleted, a word addition probability of a word of said first language sentence being added, and 
a word replacement probability of a word of said example being replaced with a word of said first language sen- 
tence. 

10 33. A translating apparatus according to claim 29, wherein said word transformation probability is calculated according 
to an optimum transformation path for transforming said example into said first language sentence. 

34. A translating apparatus according to claim 33. wherein said optimum transformation path is found by dynamic pro- 
gramming. 

15 

35. A translating apparatus according to claim 32, wherein said word transformation probability is calculated further 
using at least one among a word scramble probability of a word of said example unchanged or replaced with a word 
of said first language sentence being used with its position changed, a word copy and compound probability of a 
word of said example having a modifier added thereto and being used as a compound word, and a word replace 

20 and compound probability of a word of said example replaced with a word of said first language sentence having a 
modifier added thereto and being used as a compound word. 

36. A translating apparatus according to claim 32, wherein said word transformation probability is calculated according 
to an optimum transformation path for transforming said example into said first language sentence. 

25 

37. A translating apparatus according to claim 36. wherein in finding said optimum transformation path instead of an 
actual deletion path corresponding to actually deleting a word of said example a provisional deletion path provision- 
ally deleting a word of said example is used and instead of an actual addition path corresponding to actually adding 
a word of said first language sentence a provisional addition path provisionally adding a word of said first language 

30 sentence is used, 

further comprising word memory means for storing a provisionally deleted word and a provisionally added 
word provisionally deleted or added according to said provisional deletion path or said provisional addition path. 

38. A translating apparatus according to claim 37, wherein a scramble path corresponding to using a word of said 
35 example unchanged or replaced with a word of said first language sentence with its position changed is selected 

only when either a word of said example has been stored in said word memory means as said provisionally deleted 
word or a word of said first language sentence has been stored in said word memory means as said provisionally 
added word, and thereafter said word of said example stored as said provisionally deleted word or said word of said 
syntax unit stored as said provisionally added word is erased from said word memory means, and 

40 a copy and compound path corresponding to a word of said example having a modif ier added thereto and 

being used as a compound word and a replace and compound path corresponding to a word of said example 
replaced with a word of said first language sentence having a modifier added to it and being used as a compound 
word are selected only when a word to become said modifier has been stored in said word memory means as said 
provisionally added word, and thereafter said word to become a modifier stored as said provisionally added word 

45 is erased from said word memory means. 

39. A translating apparatus according to claim 38, wherein after the end point of a transformation path transforming 
said example into said first language sentence is reached a provisional deletion path or a provisional addition path 
provisionally deleting or adding said provisionally deleted word or said provisionally added word stored in said word 

so memory means is converted into an actual deleting path or an actual addition path respectively and the path 
obtained is made the optimum transformation path. 

40. A translating method for translating a first language sentence expressed in a first language into a second language 
sentence expressed in a second language using example memory means (3.5) storing examples expressed in said 

55 first language and corresponding translations of said examples in said second language, comprising the steps of: 

detecting (6) from among said examples an example similar to said first language sentence on the basis of a 
priori probability of said example being used for translating said first language sentence and a transformation 
probability of said example being transformed into said first language sentence and used; and 
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translating (7) said first language sentence on the basis of a translation among said translations corresponding 
to said example detected. 

41. A translating apparatus for translating a first language sentence expressed in a first language into a second lan- 
" 5 guage sentence expressed in a second language, comprising: 

example memory means (3,5) storing examples expressed in said first language and corresponding transla- 
tions of said examples in said second language together with grammatical attributes of said examples; 
extracting means for extracting grammatical attributes of said first language sentence by carrying out syntax 
io analysis of said first language sentence; 

detecting means (6) for detecting among said examples an example similar to said first language sentence tak- 
ing into account grammatical attributes of said first language sentence and of said examples; and 
translating means (7) for translating said first language sentence on the basis of a translation among said 
translations corresponding to said example detected by said detecting means. 

15 

42. A translating method for translating a first language sentence expressed in a first language into a second language 
sentence expressed in a second language using example memory means storing examples expressed in said first 
language and corresponding translations of said examples in said second language and grammatical attributes of 
said examples, comprising the steps of: 

20 

extracting grammatical attributes of said first language sentence by carrying out syntax analysis of said first 
language sentence; 

detecting (6) among said examples an example similar to said first language sentence taking into account 
grammatical attributes of said first language sentence and of saidexamples; and 
25 translating (7) said first language sentence on the basis of a translation among said translations which corre- 

sponds to said example detected. 
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FIG. 16 
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(54) Translating apparatus and translating method 

(57) A translating apparatus and a translating 
method wherein a first language sentence is divided (4) 
into syntax units consisting of predetermined units of 
sentence structure such as clauses and phrases in 
stages from large syntax units into small syntax units 
and at each stage stored (3,5) examples most similar to 
these syntax units are detected (6) using probability 
(11) models taking into account grammatical attributes 
of the syntax units and of the examples and using gen- 
eralized linguistic knowledge and with reference to a 
thesaurus (1 2) and the syntax units are translated (7) on 
the basis of these detected examples and the results of 
translation of the syntax units are compounded to gen- 
erate a second language sentence. The invention 
makes it possible to carry out high-quality translating 
efficiently and therefore at a high processing speed 
while eliminating the need for many superficially differ- 
ent examples having the same meaning content to be 
prepared and the need for the thesaurus (12) to be reg- 
ularly structured or have uniform distances between 
concepts. 
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